00000001:02000400:3.0F:1788448237.665884:0:2965:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1788448259.960874:0:3186:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1788448261.857907:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 438 MB/s 00000001:01000000:0.0F:1788448262.110841:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 573 MB/s 00000001:01000000:1.0:1788448262.360682:0:3249:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3559 MB/s 00000020:02000000:0.0:1788448263.178091:0:3278:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_103_g02cdcd5 00000400:02000000:0.0:1788448264.134062:0:3293:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.204.137@tcp [8/256/0/180] 00008000:02000000:2.0:1788448267.786650:0:3442:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:1.0:1788448320.996489:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788448330.212380:0:5818:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448330.212386:0:5818:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788448330.212544:0:5818:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000004488ccc1 00000080:02000400:3.0:1788448330.212558:0:5818:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1788448330.226590:0:5818:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1788448330.226613:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788448330.226661:0:5818:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000005902b8eb) 00000020:00000080:3.0:1788448330.226686:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1788448330.246645:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1788448330.249329:0:5818:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1788448330.276639:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1788448330.276680:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788448330.276712:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1788448330.276766:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788448330.276789:0:5818:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1788448330.278601:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788448330.278611:0:5818:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448330.278622:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aab38 00000020:01000004:2.0:1788448330.278631:0:5818:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788448330.278636:0:5818:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788448330.278641:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004488ccc1 from MGS 00000020:01000004:2.0:1788448330.278645:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788448330.278666:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000000776aaca) 00000020:00000080:2.0:1788448330.278678:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788448330.278978:0:5818:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004488ccc1 from MGS, refs=2 00080000:01000000:2.0:1788448330.278984:0:5818:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448330.278989:0:5818:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aab46 00000100:00100000:2.0:1788448330.279102:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788448330.279380:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788448330.279387:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788448330.283125:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788448330.283144:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788448330.286286:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448330.286593:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788448330.286600:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788448330.287654:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788448330.287662:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788448330.288316:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788448330.288385:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788448330.291775:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.291780:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.291782:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.292095:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.292097:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.292099:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448330.292873:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1788448330.295883:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1788448330.542322:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2243 MB/s 00000001:01000000:2.0:1788448330.792393:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 4287 MB/s 00000001:01000000:2.0:1788448331.042412:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 411 MB/s 00000001:01000000:0.0:1788448331.292528:0:5818:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 1291 MB/s 00080000:10000000:0.0:1788448331.298041:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1788448331.301225:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1788448331.307880:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1788448331.307903:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788448331.307906:0:5818:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1788448331.308664:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1788448331.308736:0:5818:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1788448331.308784:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1788448331.308951:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788448331.308980:0:5818:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1788448331.309587:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448331.309767:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1788448331.309781:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1788448331.310511:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1788448331.310519:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788448331.310872:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788448331.310879:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788448331.315873:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788448331.315900:0:5818:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.137@tcp' 00000020:01000004:1.0:1788448331.315901:0:5818:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788448331.315970:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.137@tcp (typ=mgc) 00000020:00000080:1.0:1788448331.315991:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.137@tcp (00000000a009c382) 00000020:00000080:1.0:1788448331.316008:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788448331.316138:0:5818:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d6b3fdc7@MGC192.168.204.137@tcp: add connection 192.168.204.137@tcp at head 00010000:00010000:1.0:1788448331.316312:0:5818:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.137@tcp-0 is initialized 00000040:01000000:1.0:1788448331.316320:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788448331.319236:0:5834:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1788448331.319303:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.137@tcp (uuid 623f2df2-d49f-4f54-8e7f-befebe2e7643) 00000020:00000080:1.0:1788448331.319330:0:5818:0:(genops.c:1385:class_connect()) connect: client 623f2df2-d49f-4f54-8e7f-befebe2e7643, cookie 0xd0e9b344b90aab54 00000100:00080000:1.0:1788448331.319347:0:5818:0:(import.c:510:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448331.319352:0:5818:0:(import.c:624:import_select_connection()) MGC192.168.204.137@tcp: import 00000000d6b3fdc7 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448331.319400:0:5818:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000ef714985 x1875323926872192/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448331.319426:0:5818:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS 00000020:01000004:1.0:1788448331.319445:0:5818:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1788448331.319450:0:5818:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1788448331.319464:0:5818:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000004e6565e8) 00000020:00000080:1.0:1788448331.319478:0:5818:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1788448331.321500:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ef714985 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926872192:0@lo:250: 00000100:00100000:2.0:1788448331.321619:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448331.323341:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872192 00000100:00100000:0.0:1788448331.323355:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872192 00000100:00100000:0.0:1788448331.323404:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448331.323413:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f6f42ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1875323926872192:12345-0@lo:250: 00010000:00080000:0.0:1788448331.323443:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 623f2df2-d49f-4f54-8e7f-befebe2e7643@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:0.0:1788448331.323472:0:5829:0:(genops.c:1385:class_connect()) connect: client 623f2df2-d49f-4f54-8e7f-befebe2e7643, cookie 0xd0e9b344b90aab62 00000100:00080000:0.0:1788448331.323621:0:5829:0:(import.c:65:import_set_state_nolock()) 00000000bedb1e31 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448331.323718:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f6f42ef pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:3308:x1875323926872192:12345-0@lo:250: Request processed in 304us (2098us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.323725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788448331.323879:0:5833:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:3.0:1788448331.325613:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788448331.325629:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.137@tcp: connect to target with instance 0 00000100:00080000:3.0:1788448331.325638:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788448331.325643:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788448331.325647:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000d6b3fdc7 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788448331.325651:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788448331.325663:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788448331.325669:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ef714985 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926872192:0@lo:250: 00000100:00100000:1.0:1788448331.335823:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448331.336124:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1788448331.336132:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1788448331.337567:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448331.337580:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788448331.337918:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788448331.337926:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788448331.339749:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448331.340032:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788448331.340039:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788448331.340648:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788448331.340655:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788448331.370131:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448331.370398:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788448331.370406:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788448331.375723:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788448331.375746:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788448331.377158:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448331.377582:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448331.377588:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788448331.380776:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788448331.380797:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788448331.381743:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448331.381953:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448331.381958:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788448331.382721:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448331.382728:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788448331.383496:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448331.383663:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448331.383668:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788448331.384123:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448331.384130:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788448331.402525:0:5818:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448331.402789:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448331.402796:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1788448331.404593:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448331.404606:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788448331.405130:0:5818:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788448331.405137:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1788448331.407718:0:5818:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1788448331.407745:0:5818:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1788448331.407752:0:5818:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1788448331.407905:0:5818:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788448331.407946:0:5818:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1788448331.407951:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788448331.407952:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448331.407954:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448331.407955:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448331.407956:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448331.407957:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448331.407958:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448331.407959:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448331.407961:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448331.407962:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448331.407964:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448331.407965:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448331.407967:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1788448331.407970:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448331.407970:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788448331.407972:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448331.407972:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448331.407978:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448331.407980:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448331.407980:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788448331.407981:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788448331.407982:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788448331.407982:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788448331.407983:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448331.407984:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448331.408026:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788448331.408048:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b1f52707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872320:0@lo:253: 00000100:00100000:3.0:1788448331.408135:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448331.408235:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000009460cc56 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.408461:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872320 00000100:00100000:0.0:1788448331.408470:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872320 00000100:00100000:0.0:1788448331.408519:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448331.408528:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000059f8f57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:5818:x1875323926872320:12345-0@lo:253: 20000000:01000000:0.0:1788448331.408572:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788448331.408580:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1788448331.410964:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1788448331.411326:0:5831:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1788448331.411793:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448331.413161:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788448331.413564:0:5831:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788448331.413569:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788448331.413575:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788448331.413578:0:5831:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788448331.413591:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788448331.413829:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448331.414075:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788448331.414090:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448331.414161:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1788448331.414752:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1788448331.414805:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1788448331.414925:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1788448331.414934:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1788448331.414976:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1788448331.414984:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1788448331.415015:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1788448331.415022:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1788448331.415053:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1788448331.415099:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1788448331.415135:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1788448331.415141:0:5831:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1788448331.415154:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448331.415593:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1788448331.415604:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788448331.415636:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1788448331.415662:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1788448331.415714:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1788448331.415726:0:5831:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1788448331.415802:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1788448331.415810:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788448331.415846:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1788448331.415873:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1788448331.415899:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1788448331.415908:0:5831:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1788448331.415976:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1788448331.415984:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1788448331.416010:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1788448331.416037:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1788448331.416234:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1788448331.416285:0:5831:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1788448331.416293:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1788448331.416813:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788448331.417094:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788448331.417116:0:5831:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.137@tcp for mdt 20000000:01000000:1.0:1788448331.417118:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:1.0:1788448331.417148:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788448331.417156:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788448331.417353:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788448331.417363:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:1.0:1788448331.417411:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788448331.417488:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788448331.417525:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788448331.417562:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788448331.417622:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788448331.417625:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788448331.417629:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788448331.417640:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788448331.417642:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1788448331.417670:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788448331.417672:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788448331.418084:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788448331.418414:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788448331.418533:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788448331.418595:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788448331.418609:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788448331.418611:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788448331.418948:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1788448331.419394:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1788448331.419519:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1788448331.419557:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:1.0:1788448331.419570:0:5831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448331.419573:0:5831:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:1.0:1788448331.419578:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788448331.419581:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:1.0:1788448331.419587:0:5831:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:1.0:1788448331.419594:0:5831:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1788448331.420026:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788448331.420150:0:5831:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788448331.429364:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788448331.429428:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788448331.429522:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788448331.429546:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788448331.429570:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429588:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429598:0:5831:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429604:0:5831:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429632:0:5831:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429638:0:5831:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429644:0:5831:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000007c2fd2ad already unused, calling callback (000000000c5d1f69) 00010000:00010000:1.0:1788448331.429647:0:5831:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429654:0:5831:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429667:0:5831:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429674:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.429737:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007c2fd2ad/0xd0e9b344b90aab69 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448331.429757:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788448331.770442:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000059f8f57e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:5818:x1875323926872320:12345-0@lo:253: Request processed in 361906us (362298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448331.770464:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448331.770502:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b1f52707 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872320:0@lo:253: 10000000:01000000:1.0:1788448331.770518:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788448331.770521:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448331.770523:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448331.770525:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448331.770526:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1788448331.770527:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448331.770542:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448331.770543:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448331.770544:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448331.770546:0:5818:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788448331.770547:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448331.770549:0:5818:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788448331.770569:0:5818:0:(tgt_mount.c:101:server_register_mount()) register mount 000000004488ccc1 from lustre-MDT0000 10000000:01000000:1.0:1788448331.770596:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1788448331.770599:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788448331.770603:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99a8065799b8 10000000:01000000:1.0:1788448331.770607:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448331.770614:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a8065799b8 from 1 10000000:01000000:1.0:1788448331.770618:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788448331.770655:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.770666:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.770684:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.770703:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872448:0@lo:101: 00000100:00100000:1.0:1788448331.770739:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.770798:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.770890:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872448 00000100:00100000:0.0:1788448331.770900:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872448 00000100:00100000:0.0:1788448331.770953:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448331.770961:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007e245ae7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:5818:x1875323926872448:12345-0@lo:101: 00010000:00010000:0.0:1788448331.770974:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448331.770988:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c8227a53/0xd0e9b344b90aab77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aab70 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.771010:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c8227a53/0xd0e9b344b90aab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.771020:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c8227a53/0xd0e9b344b90aab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.771029:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c8227a53, rc 0) 00000100:00100000:0.0:1788448331.771067:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007e245ae7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5818:x1875323926872448:12345-0@lo:101: Request processed in 107us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.771073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448331.771125:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872448:0@lo:101: 00010000:00010000:1.0:1788448331.771137:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.771145:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.771336:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872576:0@lo:501: 00000100:00100000:1.0:1788448331.771361:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448331.771478:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872576 00000100:00100000:3.0:1788448331.771484:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872576 00000100:00100000:1.0:1788448331.771514:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448331.771517:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448331.771523:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f80db2d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5818:x1875323926872576:12345-0@lo:501: 00000100:00100000:3.0:1788448331.771766:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f80db2d5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5818:x1875323926872576:12345-0@lo:501: Request processed in 243us (403us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448331.771773:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448331.771834:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872576:0@lo:501: 10000000:01000000:1.0:1788448331.771917:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788448331.771932:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.771940:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 000000007c2fd2ad/0xd0e9b344b90aab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448331.771947:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a80badd000 10000000:01000000:1.0:1788448331.771951:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788448331.771955:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99a80badd000 10000000:01000000:1.0:1788448331.771957:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1788448331.771960:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99a80badd000 from 1 10000000:01000000:1.0:1788448331.771962:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1788448331.771977:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.772137:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.772145:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.772166:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872704:0@lo:101: 00000100:00100000:1.0:1788448331.772244:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.772262:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.772503:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872704 00000100:00100000:0.0:1788448331.772509:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872704 00000100:00100000:0.0:1788448331.772553:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448331.772559:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000046726f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5818:x1875323926872704:12345-0@lo:101: 00010000:00010000:0.0:1788448331.772568:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448331.772578:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fb637d00/0xd0e9b344b90aab85 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aab7e expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.772592:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fb637d00/0xd0e9b344b90aab85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aab7e expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.772599:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fb637d00/0xd0e9b344b90aab85 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aab7e expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.772605:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fb637d00, rc 0) 00000100:00100000:0.0:1788448331.772780:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000046726f0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:5818:x1875323926872704:12345-0@lo:101: Request processed in 220us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.772786:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448331.774201:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872704:0@lo:101: 00010000:00010000:1.0:1788448331.774225:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.774236:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448331.774253:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1788448331.774277:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.774284:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000fb0be317/0xd0e9b344b90aab7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448331.774291:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1788448331.774299:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448331.774304:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99a80badd000 10000000:01000000:1.0:1788448331.774306:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1788448331.774309:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1788448331.774312:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448331.774347:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.774354:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.774362:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.774389:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872832:0@lo:101: 00000100:00100000:1.0:1788448331.774439:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.774621:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448331.774742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872832 00000100:00100000:2.0:1788448331.774750:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872832 00000100:00100000:0.0:1788448331.774892:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448331.774902:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c070b908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:5818:x1875323926872832:12345-0@lo:101: 00010000:00010000:0.0:1788448331.774915:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448331.774928:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001f5dae8d/0xd0e9b344b90aab93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aab8c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.774946:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001f5dae8d/0xd0e9b344b90aab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.774955:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001f5dae8d/0xd0e9b344b90aab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 8 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448331.774962:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001f5dae8d, rc 0) 00000100:00100000:0.0:1788448331.775024:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c070b908 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+8:5818:x1875323926872832:12345-0@lo:101: Request processed in 123us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.775031:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448331.775225:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872832:0@lo:101: 00010000:00010000:1.0:1788448331.775238:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448331.775246:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448331.775296:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872960:0@lo:501: 00000100:00100000:1.0:1788448331.775323:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448331.775394:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.775603:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926872960 00000100:00100000:0.0:1788448331.775609:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926872960 00000100:00100000:0.0:1788448331.775640:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448331.775647:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007f6fdd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+8:5818:x1875323926872960:12345-0@lo:501: 00000100:00100000:0.0:1788448331.776003:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007f6fdd79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5818:x1875323926872960:12345-0@lo:501: Request processed in 356us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.776011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448331.776157:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926872960:0@lo:501: 00000100:00100000:1.0:1788448331.776322:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873088:0@lo:503: 00000100:00100000:2.0:1788448331.776506:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448331.776580:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 0000000070c8d5d0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448331.776688:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873088 00000100:00100000:0.0:1788448331.776693:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873088 00000100:00100000:0.0:1788448331.776763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448331.776770:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049778d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5818:x1875323926873088:12345-0@lo:503: 00000100:00100000:0.0:1788448331.776962:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049778d61 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5818:x1875323926873088:12345-0@lo:503: Request processed in 193us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448331.776969:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448331.777143:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000acccfe45 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873088:0@lo:503: 00000100:00100000:3.0:1788448331.777733:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5860:1875323926873216:0@lo:502: 00000100:00100000:3.0:1788448331.777780:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448331.778138:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000067356305 going to sleep for 11 seconds 00000100:00100000:2.0:1788448331.778431:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873216 00000100:00100000:2.0:1788448331.778440:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873216 00000100:00100000:2.0:1788448331.778477:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448331.778485:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044154ea9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5860:x1875323926873216:12345-0@lo:502: 00000100:00100000:2.0:1788448331.778710:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044154ea9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5860:x1875323926873216:12345-0@lo:502: Request processed in 225us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448331.778718:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448331.778916:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5860:1875323926873216:0@lo:502: 00000020:01000000:3.0:1788448331.778952:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448331.778964:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448331.778967:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448331.778972:0:5860:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788448331.778975:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448331.779114:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000002eab4cf2) 00000020:00000080:3.0:1788448331.779139:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788448331.779147:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788448331.779262:0:5860:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788448331.779269:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aaba1 00000020:00000080:3.0:1788448331.779527:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788448331.779636:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448331.779641:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448331.779643:0:5860:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448331.779646:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448331.779649:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448331.779651:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788448331.779654:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448331.779661:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000009e75f98b) 00000020:00000080:3.0:1788448331.779680:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788448331.779686:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788448331.779687:0:5860:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788448331.779690:0:5860:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788448331.779697:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788448331.779754:0:5860:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004488ccc1 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788448331.779768:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b1f8ee66) 00000020:00000080:3.0:1788448331.779775:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788448331.779829:0:5860:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788448331.779834:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90aabb6 00000020:00000080:3.0:1788448331.779936:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788448331.779942:0:5860:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788448331.779947:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd0e9b344b90aabbd 00080000:01000000:3.0:1788448331.779952:0:5860:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788448331.779963:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aabc4 00080000:10000000:3.0:1788448331.780840:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1788448331.781451:0:5860:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1788448331.786767:0:5860:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1788448331.893381:0:5860:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1788448331.893789:0:5860:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1788448331.900358:0:5860:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1788448331.901329:0:5860:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788448331.980115:0:5860:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000fd54cce8) 00000020:00000080:3.0:1788448331.980138:0:5860:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1788448331.980241:0:5860:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1788448331.980247:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aabd2 00000020:00000080:3.0:1788448331.983515:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1788448331.986229:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.018563:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448332.047651:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.080989:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.143166:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448332.180908:0:5860:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:1.0:1788448332.222511:0:5860:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd0e9b344b90aabd9 00000020:00000080:1.0:1788448332.223241:0:5860:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1788448332.223252:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448332.223258:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448332.223260:0:5860:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1788448332.223263:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448332.223266:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448332.223267:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448332.223270:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448332.223272:0:5860:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448332.223294:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448332.223297:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448332.223298:0:5860:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448332.223301:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448332.223306:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448332.223307:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1788448332.223311:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788448332.223345:0:5860:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1788448332.223397:0:5860:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011158403 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5860:1875323926873344:0@lo:502: 00000100:00100000:1.0:1788448332.223476:0:5860:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448332.223537:0:5860:0:(client.c:2715:ptlrpc_set_wait()) set 0000000029992ed2 going to sleep for 11 seconds 00000100:00100000:3.0:1788448332.223728:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873344 00000100:00100000:3.0:1788448332.223736:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873344 00000100:00100000:3.0:1788448332.223788:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448332.223797:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed241356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5860:x1875323926873344:12345-0@lo:502: 00000100:00100000:3.0:1788448332.224222:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed241356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5860:x1875323926873344:12345-0@lo:502: Request processed in 426us (745us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448332.224230:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448332.224372:0:5860:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011158403 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5860:1875323926873344:0@lo:502: 00000020:01000000:1.0:1788448332.224397:0:5860:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448332.224402:0:5860:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448332.224405:0:5860:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788448332.224407:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1788448332.224618:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1788448332.224637:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788448332.224657:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.224678:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 0000000034a29860/0xd0e9b344b90aab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448332.224687:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a80badd000 from 1 10000000:01000000:3.0:1788448332.224697:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448332.224725:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.224733:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.224742:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.224757:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873472:0@lo:101: 00000100:00100000:3.0:1788448332.224797:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.224830:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8361671 going to sleep for 11 seconds 00000100:00100000:1.0:1788448332.224923:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873472 00000100:00100000:1.0:1788448332.224928:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873472 00000100:00100000:1.0:1788448332.224957:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448332.224964:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000020fdfd51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:5818:x1875323926873472:12345-0@lo:101: 00010000:00010000:1.0:1788448332.224974:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448332.224987:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aabe0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.225008:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.225017:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.225037:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000d03ce184, rc 0) 00000100:00100000:1.0:1788448332.225137:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000020fdfd51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:5818:x1875323926873472:12345-0@lo:101: Request processed in 173us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.225143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788448332.225317:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873472:0@lo:101: 00010000:00010000:3.0:1788448332.225329:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.225338:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.226172:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873600:0@lo:256: 00000100:00100000:3.0:1788448332.226362:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.226427:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8361671 going to sleep for 11 seconds 00000100:00100000:0.0:1788448332.226519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873600 00000100:00100000:0.0:1788448332.226525:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873600 00000100:00100000:0.0:1788448332.226588:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448332.226597:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000045c7402b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:5818:x1875323926873600:12345-0@lo:256: 20000000:01000000:0.0:1788448332.226612:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:0.0:1788448332.226618:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:0.0:1788448332.226711:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000045c7402b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:5818:x1875323926873600:12345-0@lo:256: Request processed in 115us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448332.226726:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448332.226802:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873600:0@lo:256: 10000000:01000000:3.0:1788448332.227352:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448332.227374:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.227383:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448332.227397:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80badd000 from 1 10000000:01000000:3.0:1788448332.227400:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448332.227423:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.227430:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.227438:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.227450:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873728:0@lo:101: 00000100:00100000:3.0:1788448332.227478:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.227740:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8361671 going to sleep for 11 seconds 00000100:00100000:1.0:1788448332.227868:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873728 00000100:00100000:1.0:1788448332.227874:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873728 00000100:00100000:1.0:1788448332.227903:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448332.227909:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006df7a7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:5818:x1875323926873728:12345-0@lo:101: 00010000:00010000:1.0:1788448332.227919:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448332.227930:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aabee expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.227947:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.227955:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.227962:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce004cc0, rc 0) 00000100:00100000:1.0:1788448332.228001:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006df7a7ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926873728:12345-0@lo:101: Request processed in 91us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.228007:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448332.228138:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873728:0@lo:101: 00010000:00010000:3.0:1788448332.228151:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.228159:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.228233:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873856:0@lo:501: 00000100:00100000:3.0:1788448332.228259:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.228274:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8361671 going to sleep for 11 seconds 00000100:00100000:2.0:1788448332.228364:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873856 00000100:00100000:2.0:1788448332.228370:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873856 00000100:00100000:1.0:1788448332.228408:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448332.228414:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4099f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926873856:12345-0@lo:501: 00000100:00100000:1.0:1788448332.229238:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4099f5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926873856:12345-0@lo:501: Request processed in 822us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.229247:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448332.229440:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873856:0@lo:501: 00000100:00100000:3.0:1788448332.229485:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873984:0@lo:503: 00000100:00100000:3.0:1788448332.229544:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.229581:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a8361671 going to sleep for 11 seconds 00000100:00100000:1.0:1788448332.229637:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926873984 00000100:00100000:1.0:1788448332.229643:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926873984 00000100:00100000:1.0:1788448332.229698:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448332.229706:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003b6bd8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926873984:12345-0@lo:503: 00000040:00080000:1.0:1788448332.229741:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448332.229934:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003b6bd8c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926873984:12345-0@lo:503: Request processed in 229us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.229941:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448332.230018:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926873984:0@lo:503: 00000040:00080000:0.0:1788448332.231511:0:5864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1788448332.231707:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1788448332.231727:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448332.231744:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.231756:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448332.231926:0:5818:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448332.231930:0:5818:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a80badd000 10000000:01000000:3.0:1788448332.231933:0:5818:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a80badd000 10000000:01000000:3.0:1788448332.231937:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448332.231943:0:5818:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80badd000 from 1 10000000:01000000:3.0:1788448332.231946:0:5818:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448332.231991:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.232003:0:5818:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.232014:0:5818:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.232117:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874112:0@lo:101: 00000100:00100000:3.0:1788448332.232215:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.232245:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c47d487 going to sleep for 11 seconds 00000100:00100000:0.0:1788448332.232324:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874112 00000100:00100000:0.0:1788448332.232331:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874112 00000100:00100000:0.0:1788448332.232423:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448332.232434:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000252a7dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926874112:12345-0@lo:101: 00010000:00010000:0.0:1788448332.232447:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448332.232460:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004652a30b/0xd0e9b344b90aac03 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aabfc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448332.232482:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004652a30b/0xd0e9b344b90aac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448332.232491:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004652a30b/0xd0e9b344b90aac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448332.232499:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004652a30b, rc 0) 00000100:00100000:0.0:1788448332.232542:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000252a7dda pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874112:12345-0@lo:101: Request processed in 109us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448332.232549:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788448332.232637:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874112:0@lo:101: 00010000:00010000:3.0:1788448332.232655:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448332.232673:0:5818:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448332.232730:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874240:0@lo:501: 00000100:00100000:3.0:1788448332.232759:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.232954:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c47d487 going to sleep for 11 seconds 00000100:00100000:2.0:1788448332.233012:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874240 00000100:00100000:2.0:1788448332.233016:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874240 00000100:00100000:2.0:1788448332.233039:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448332.233044:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fb0bfc2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874240:12345-0@lo:501: 00000100:00100000:2.0:1788448332.233347:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fb0bfc2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874240:12345-0@lo:501: Request processed in 302us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448332.233354:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788448332.233597:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874240:0@lo:501: 00000100:00100000:3.0:1788448332.233632:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874368:0@lo:503: 00000100:00100000:3.0:1788448332.233693:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.233716:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 000000001c47d487 going to sleep for 11 seconds 00000100:00100000:2.0:1788448332.234162:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874368 00000100:00100000:2.0:1788448332.234167:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874368 00000100:00100000:2.0:1788448332.234215:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448332.234222:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000681f9861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874368:12345-0@lo:503: 00000100:00100000:2.0:1788448332.234517:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000681f9861 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874368:12345-0@lo:503: Request processed in 295us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448332.234524:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448332.234617:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874368:0@lo:503: 00000100:00100000:3.0:1788448332.235632:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5865:1875323926874496:0@lo:502: 00000100:00100000:3.0:1788448332.235692:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.235770:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000615c01d3 going to sleep for 11 seconds 00000100:00100000:2.0:1788448332.235914:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874496 00000100:00100000:2.0:1788448332.235920:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874496 00000100:00100000:2.0:1788448332.235988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788448332.235995:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000112a4194 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5865:x1875323926874496:12345-0@lo:502: 00000100:00100000:2.0:1788448332.236269:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000112a4194 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5865:x1875323926874496:12345-0@lo:502: Request processed in 275us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448332.236277:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448332.236353:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5865:1875323926874496:0@lo:502: 00000020:01000004:3.0:1788448332.236408:0:5865:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788448332.236424:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001bf0e855) 00000020:00000080:3.0:1788448332.236442:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1788448332.236524:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 000000004488ccc1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788448332.236528:0:5865:0:(tgt_mount.c:187:server_put_mount()) put mount 000000004488ccc1 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788448332.236531:0:5865:0:(obd_mount.c:710:lustre_put_lsi()) put 000000004488ccc1 4 00010000:00080000:3.0:1788448332.236558:0:5865:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000471e19ec@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448332.238582:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:3.0:1788448332.238937:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788448332.238971:0:5865:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448332.238982:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd0e9b344b90aac11 00000100:00080000:3.0:1788448332.238993:0:5865:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448332.238998:0:5865:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000471e19ec using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448332.239035:0:5865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000028ffd090 x1875323926874624/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448332.239156:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926874624:0@lo:38: 00000100:00100000:3.0:1788448332.239241:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448332.239299:0:5865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788448332.241453:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874624 00000100:00100000:0.0:1788448332.241467:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874624 00000100:00100000:0.0:1788448332.241507:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448332.241514:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008911546e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875323926874624:12345-0@lo:38: 00000100:00100000:0.0:1788448332.241601:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008911546e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875323926874624:12345-0@lo:38: Request processed in 85us (2359us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788448332.241608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448332.241657:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448332.241685:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000471e19ec lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448332.241690:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788448332.241694:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000028ffd090 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926874624:0@lo:38: 00000100:00100000:3.0:1788448332.243277:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000091724c4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5865:1875323926874752:0@lo:502: 00000100:00100000:3.0:1788448332.243351:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448332.243433:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f9510371 going to sleep for 11 seconds 00000100:00100000:2.0:1788448332.245160:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874752 00000100:00100000:2.0:1788448332.245171:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874752 00000100:00100000:2.0:1788448332.245250:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788448332.245259:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000035614a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5865:x1875323926874752:12345-0@lo:502: 00000100:00100000:2.0:1788448332.245518:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000035614a58 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5865:x1875323926874752:12345-0@lo:502: Request processed in 260us (2167us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448332.245527:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788448332.245681:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000091724c4e pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:5865:1875323926874752:0@lo:502: 00000040:00080000:2.0:1788448332.245729:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1788448332.247897:0:5818:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1788448332.247932:0:5818:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448332.248001:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.248015:0:5818:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 0000000009752606/0xd0e9b344b90aabfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788448332.248077:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788448332.248080:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448332.248081:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448332.248082:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448332.248083:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448332.248084:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448332.248085:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448332.248087:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448332.248088:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448332.248089:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448332.248091:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448332.248092:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448332.248096:0:5818:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1788448332.248098:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788448332.248099:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448332.248100:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448332.248101:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448332.248103:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448332.248109:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448332.248110:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448332.248111:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448332.248112:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448332.248112:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448332.248113:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448332.248114:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448332.248140:0:5818:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1788448332.248157:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000011158403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874880:0@lo:253: 00000100:00100000:1.0:1788448332.248387:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448332.248498:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd1fa6d4 going to sleep for 11 seconds 00000100:00100000:0.0:1788448332.249297:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926874880 00000100:00100000:0.0:1788448332.249306:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926874880 00000100:00100000:0.0:1788448332.249353:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448332.249361:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d88de9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5818:x1875323926874880:12345-0@lo:253: 20000000:01000000:0.0:1788448332.249393:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448332.249407:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448332.280747:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448332.280770:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1788448332.280895:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448332.280900:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448332.280928:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448332.280949:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448332.280957:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448332.281025:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448332.281041:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 12 pid: 5830 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448332.281057:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001fe7624d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926875008:0@lo:104: 00000100:00100000:2.0:1788448332.281134:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448332.281229:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set 0000000064bd5ef1 going to sleep for 11 seconds 00000100:00100000:1.0:1788448332.281298:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875008 00000100:00100000:1.0:1788448332.281307:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875008 00000100:00100000:1.0:1788448332.281364:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448332.281373:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c6a321f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926875008:12345-0@lo:104: 00010000:00010000:1.0:1788448332.281385:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281443:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448332.281448:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c6a321f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926875008:12345-0@lo:104: Request processed in 78us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.281455:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1788448332.281478:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448332.281482:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281489:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000695a4309 already unused, calling callback (000000008cf62375) 10000000:00010000:1.0:1788448332.281492:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281499:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448332.281517:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448332.281522:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448332.281549:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281555:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448332.281571:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281576:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: 00000000695a4309/0xd0e9b344b90aabe0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabe7 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281594:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448332.281596:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448332.281597:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448332.281647:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926875136:0@lo:103: 00000100:00100000:1.0:1788448332.281689:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448332.281770:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875136 00000100:00100000:1.0:1788448332.281774:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875136 00010000:00010000:1.0:1788448332.281802:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 13 pid: 5830 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448332.281824:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448332.281830:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f51e6b90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3310:x1875323926875136:12345-0@lo:103: 00010000:00010000:1.0:1788448332.281838:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448332.281843:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 13 pid: 5830 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281858:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 13 pid: 5830 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281874:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281882:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448332.281894:0:5822:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.000994685s 00010000:00010000:1.0:1788448332.281897:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281904:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281909:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281914:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281919:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e9d5c1ef already unused, calling callback (000000000c5d1f69) 00010000:00010000:1.0:1788448332.281922:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281928:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281934:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.281952:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448332.281979:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f51e6b90 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3310:x1875323926875136:12345-0@lo:103: Request processed in 150us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448332.281985:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448332.282017:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926875136:0@lo:103: 00010000:00010000:1.0:1788448332.282045:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000d03ce184/0xd0e9b344b90aabe7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aabe0 expref: 12 pid: 5830 timeout: 342 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448332.282054:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001fe7624d pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926875008:0@lo:104: 00010000:00010000:1.0:1788448332.282065:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.282073:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.282080:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448332.282085:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e9d5c1ef/0xd0e9b344b90aac18 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448332.292476:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d88de9c5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5818:x1875323926874880:12345-0@lo:253: Request processed in 43105us (44079us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448332.292495:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448332.292600:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000011158403 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:5818:1875323926874880:0@lo:253: 10000000:01000000:1.0:1788448332.292617:0:5818:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1788448332.292620:0:5818:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448332.292622:0:5818:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1788448332.292623:0:5818:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448332.292624:0:5818:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448332.292626:0:5818:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448332.292642:0:5818:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448332.292643:0:5818:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788448332.292645:0:5818:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1788448332.292646:0:5818:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448332.292648:0:5818:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448332.292649:0:5818:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448332.292651:0:5818:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788448332.292679:0:5818:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788448332.297644:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448332.298262:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448332.298558:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448332.299071:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448332.300659:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448332.301493:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448332.303701:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.304023:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448332.304248:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.306091:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448332.306919:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448332.307649:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00010000:00010000:0.0:1788448332.322031:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1788448332.352091:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1788448332.397769:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788448332.398121:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788448332.400911:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788448332.401072:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788448332.401535:0:5818:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788448332.401543:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788448332.401736:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788448332.401788:0:5871:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788448332.401794:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:00080000:3.0:1788448332.404616:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1788448332.405204:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788448332.405236:0:5818:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1788448332.405627:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788448332.405898:0:5818:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:2.0:1788448332.416794:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:2.0:1788448332.416934:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788448332.420635:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788448332.420923:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1788448332.423944:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788448332.424433:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1788448332.424563:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788448332.424735:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788448332.424853:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788448332.424990:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788448332.427504:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788448332.427714:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788448332.427857:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1788448332.428015:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788448332.428832:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788448332.428971:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788448332.434672:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788448332.434928:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788448332.436386:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788448332.436625:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788448332.436824:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788448332.437003:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788448332.437823:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788448332.437994:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788448332.440014:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788448332.440808:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788448332.440953:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788448332.442821:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788448332.444763:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788448332.444980:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788448332.445139:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788448332.447808:0:5818:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788448332.448091:0:5818:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1788448332.491110:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:3.0:1788448332.549593:0:5818:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788448332.549633:0:5818:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbcbc1d73988 00100000:10000000:3.0:1788448332.549642:0:5818:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788448332.551009:0:5818:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788448332.551026:0:5818:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788448332.551044:0:5818:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1788448332.551070:0:5818:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1788448332.605114:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788448332.605206:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788448332.605211:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1788448333.364017:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448334.368468:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448335.394294:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448336.424936:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448337.355595:0:6114:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788448337.441226:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448337.506987:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788448337.506995:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788448337.506998:0:38:0:(import.c:65:import_set_state_nolock()) 00000000471e19ec lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448337.507010:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000471e19ec using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1788448337.507032:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000150d7d4f x1875323926875392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448337.507126:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448337.507140:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000438107c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926875264:0@lo:400: 00000100:00100000:2.0:1788448337.507234:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448337.507291:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000150d7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926875392:0@lo:38: 00000100:00100000:2.0:1788448337.507322:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448337.508121:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875392 00000100:00100000:1.0:1788448337.508130:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875392 00000100:00100000:1.0:1788448337.508173:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448337.508180:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009a551796 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875323926875392:12345-0@lo:38: 00010000:00080000:1.0:1788448337.508226:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 198 last 0 00000020:00000080:1.0:1788448337.508261:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd0e9b344b90aac1f 00000004:00100000:1.0:1788448337.508300:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1788448337.508970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875264 00000100:00100000:0.0:1788448337.508976:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875264 00000100:00100000:0.0:1788448337.509009:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448337.509016:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000437d99a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:3312:x1875323926875264:12345-0@lo:400: 00000100:00100000:0.0:1788448337.509088:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000437d99a7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:3312:x1875323926875264:12345-0@lo:400: Request processed in 73us (1854us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448337.509094:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1788448337.509160:0:5839:0:(import.c:65:import_set_state_nolock()) 00000000e30c6e6c : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448337.509235:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009a551796 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875323926875392:12345-0@lo:38: Request processed in 1055us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448337.509242:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448337.509325:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000438107c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926875264:0@lo:400: 00010000:00080000:0.0:1788448337.510181:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000150d7d4f x1875323926875392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448347 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788448337.510239:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788448337.510247:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788448337.510252:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788448337.510254:0:3308:0:(import.c:65:import_set_state_nolock()) 00000000471e19ec lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788448337.510260:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000150d7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926875392:0@lo:38: 00010000:00010000:0.0:1788448338.467534:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788448339.040328:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788448339.040337:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a80badd000 from 3 10000000:01000000:3.0:1788448339.040341:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448339.040381:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448339.040393:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448339.040413:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448339.040435:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926875520:0@lo:101: 00000100:00100000:3.0:1788448339.040502:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448339.040575:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd649949 going to sleep for 11 seconds 00000100:00100000:1.0:1788448339.040592:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875520 00000100:00100000:1.0:1788448339.040600:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875520 00000100:00100000:1.0:1788448339.040663:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448339.040673:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8e60175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5834:x1875323926875520:12345-0@lo:101: 00010000:00010000:1.0:1788448339.041363:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448339.041379:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e0bfdcd5/0xd0e9b344b90aac2d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac26 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448339.041403:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e0bfdcd5/0xd0e9b344b90aac2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448339.041596:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e0bfdcd5/0xd0e9b344b90aac2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448339.041607:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e0bfdcd5, rc 0) 00000100:00100000:1.0:1788448339.041658:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8e60175 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926875520:12345-0@lo:101: Request processed in 987us (1156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448339.041666:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788448339.044167:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926875520:0@lo:101: 00010000:00010000:3.0:1788448339.044209:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448339.044221:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448339.044292:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926875648:0@lo:256: 00000100:00100000:3.0:1788448339.044350:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448339.044390:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bd649949 going to sleep for 11 seconds 00000100:00100000:2.0:1788448339.047429:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875648 00000100:00100000:2.0:1788448339.047446:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875648 00000100:00100000:2.0:1788448339.047512:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448339.047521:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bb6ca6dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926875648:12345-0@lo:256: 20000000:01000000:2.0:1788448339.047557:0:5830:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448339.047573:0:5830:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448339.047576:0:5830:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:2.0:1788448339.047711:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bb6ca6dd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926875648:12345-0@lo:256: Request processed in 192us (3361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448339.047719:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448339.047728:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926875648:0@lo:256: 10000000:01000000:3.0:1788448339.047784:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448339.047792:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448339.047802:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: 00000000e9ca7897/0xd0e9b344b90aac26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448339.488873:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448340.512448:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448341.536443:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448342.561296:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448342.624410:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006dfe55e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926875776:0@lo:400: 00000100:00100000:1.0:1788448342.624502:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448342.624550:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875776 00000100:00100000:3.0:1788448342.624559:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875776 00000100:00100000:3.0:1788448342.624643:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448342.624652:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000044797f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3312:x1875323926875776:12345-0@lo:400: 00000100:00100000:3.0:1788448342.627448:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000044797f06 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3312:x1875323926875776:12345-0@lo:400: Request processed in 2789us (2938us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448342.627448:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006f5ba083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926875904:0@lo:400: 00000100:00100000:3.0:1788448342.627480:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448342.627595:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448342.627914:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006dfe55e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926875776:0@lo:400: 00000100:00100000:3.0:1788448342.630458:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926875904 00000100:00100000:3.0:1788448342.630484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926875904 00000100:00100000:3.0:1788448342.630597:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448342.630607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5ed96b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926875904:12345-0@lo:400: 00000100:00100000:3.0:1788448342.630747:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5ed96b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926875904:12345-0@lo:400: Request processed in 143us (3153us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448342.630755:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788448342.630804:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f5ba083 x1875323926875904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448342.630820:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006f5ba083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926875904:0@lo:400: 00000020:00000080:1.0:1788448342.673508:0:6316:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffc8909940 20000000:00000080:1.0:1788448342.673530:0:6316:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a809931400 uarg=0000000000000000 20000000:01000000:1.0:1788448342.673567:0:6316:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1788448342.673574:0:6316:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1788448342.673579:0:6316:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788448342.674115:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1788448342.674127:0:6316:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788448342.683413:0:6316:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448342.684258:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788448342.684328:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788448342.684387:0:6316:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788448342.684407:0:6316:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788448342.684427:0:6316:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.684446:0:6316:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.684453:0:6316:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.684520:0:6316:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.684535:0:6316:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 11 pid: 5830 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448342.684550:0:6316:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875323926876032:0@lo:104: 00000100:00100000:3.0:1788448342.685124:0:6316:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448342.685221:0:6316:0:(client.c:2715:ptlrpc_set_wait()) set 0000000084668081 going to sleep for 11 seconds 00000100:00100000:2.0:1788448342.685613:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876032 00000100:00100000:2.0:1788448342.685750:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876032 00000100:00100000:2.0:1788448342.685869:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448342.685879:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001723897b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:6316:x1875323926876032:12345-0@lo:104: 00010000:00010000:2.0:1788448342.685894:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.685972:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448342.685978:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001723897b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:6316:x1875323926876032:12345-0@lo:104: Request processed in 102us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448342.685998:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448342.686083:0:6316:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6316:1875323926876032:0@lo:104: 00010000:00010000:3.0:1788448342.686112:0:6316:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448342.686233:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448342.686239:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448342.686250:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000eadeb018 already unused, calling callback (000000008cf62375) 10000000:00010000:0.0:1788448342.686256:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448342.686263:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448342.686270:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448342.686276:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788448342.686314:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448342.686331:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448342.686432:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448342.686437:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e7355f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926876160:0@lo:103: 00010000:00010000:0.0:1788448342.686439:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: 00000000eadeb018/0xd0e9b344b90aabee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aabf5 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448342.686458:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448342.686472:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448342.686474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448342.686493:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448342.686671:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876160 00000100:00100000:2.0:1788448342.686676:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876160 00010000:00010000:2.0:1788448342.686696:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 12 pid: 5830 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448342.686727:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448342.686734:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000011158403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3310:x1875323926876160:12345-0@lo:103: 00010000:00010000:2.0:1788448342.686744:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448342.686749:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 12 pid: 5830 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686759:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 12 pid: 5830 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686772:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce004cc0/0xd0e9b344b90aabf5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aabee expref: 12 pid: 5830 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686786:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686793:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686805:0:5822:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686812:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686817:0:5822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686828:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686834:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000018c16b87 already unused, calling callback (000000000c5d1f69) 00010000:00010000:2.0:1788448342.686837:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686843:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.686959:0:6316:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686959:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448342.686967:0:6316:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 2/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448342.686970:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448342.686972:0:6316:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000018c16b87/0xd0e9b344b90aac34 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6316 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448342.687007:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000011158403 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:3310:x1875323926876160:12345-0@lo:103: Request processed in 274us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448342.687013:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448342.687069:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e7355f4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926876160:0@lo:103: 00010000:00010000:0.0:1788448343.594466:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448344.620285:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448345.638907:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448346.659422:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788448347.232835:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448347.232848:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80badd000 from 1 10000000:01000000:3.0:1788448347.232854:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448347.233114:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: 0000000018c16b87/0xd0e9b344b90aac3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448347.233133:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: 0000000018c16b87/0xd0e9b344b90aac3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448347.233166:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: 0000000018c16b87/0xd0e9b344b90aac3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448347.233257:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876288:0@lo:101: 00000100:00100000:3.0:1788448347.233337:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448347.233408:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 00000000895107e4 going to sleep for 11 seconds 00000100:00100000:0.0:1788448347.233444:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876288 00000100:00100000:0.0:1788448347.233458:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876288 00000100:00100000:0.0:1788448347.233552:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788448347.233563:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005af1e1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:5834:x1875323926876288:12345-0@lo:101: 00010000:00010000:0.0:1788448347.233583:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448347.233611:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000058ba8777/0xd0e9b344b90aac42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac3b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448347.233640:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000058ba8777/0xd0e9b344b90aac42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448347.233653:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000058ba8777/0xd0e9b344b90aac42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448347.233663:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000058ba8777, rc 0) 00000100:00100000:0.0:1788448347.233744:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005af1e1de pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926876288:12345-0@lo:101: Request processed in 183us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448347.233763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448347.233870:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000167e7228 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876288:0@lo:101: 00010000:00010000:1.0:1788448347.233890:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: 0000000018c16b87/0xd0e9b344b90aac3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448347.233900:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: 0000000018c16b87/0xd0e9b344b90aac3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448347.233971:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876416:0@lo:501: 00000100:00100000:1.0:1788448347.234007:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.234038:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e9ec457 going to sleep for 11 seconds 00000100:00100000:0.0:1788448347.234392:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876416 00000100:00100000:0.0:1788448347.234398:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876416 00000100:00100000:0.0:1788448347.234431:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448347.234438:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000777b62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926876416:12345-0@lo:501: 00000100:00100000:0.0:1788448347.234933:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000777b62c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926876416:12345-0@lo:501: Request processed in 494us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448347.234941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788448347.235013:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876416:0@lo:501: 00000100:00100000:1.0:1788448347.235051:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876544:0@lo:503: 00000100:00100000:1.0:1788448347.235095:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.235126:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e9ec457 going to sleep for 11 seconds 00000100:00100000:3.0:1788448347.235220:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876544 00000100:00100000:3.0:1788448347.235225:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876544 00000100:00100000:3.0:1788448347.235268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448347.235275:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f712701d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926876544:12345-0@lo:503: 00000100:00100000:3.0:1788448347.235807:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f712701d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926876544:12345-0@lo:503: Request processed in 530us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448347.235815:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788448347.235906:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926876544:0@lo:503: 00000100:00100000:1.0:1788448347.236557:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6560:1875323926876672:0@lo:502: 00000100:00100000:1.0:1788448347.236948:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.236996:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set 0000000071fd8643 going to sleep for 11 seconds 00000100:00100000:0.0:1788448347.237061:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876672 00000100:00100000:0.0:1788448347.237070:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876672 00000100:00100000:0.0:1788448347.237121:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788448347.237130:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d332b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6560:x1875323926876672:12345-0@lo:502: 00000100:00100000:0.0:1788448347.237443:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d332b6d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6560:x1875323926876672:12345-0@lo:502: Request processed in 313us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448347.237451:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788448347.237827:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000035556145 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6560:1875323926876672:0@lo:502: 00000020:01000000:1.0:1788448347.237860:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448347.237872:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448347.237883:0:6560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788448347.237891:0:6560:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a80badd000 00000020:00000080:1.0:1788448347.237893:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788448347.237954:0:6560:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807977100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6560:1875323926876800:0@lo:502: 00000100:00100000:1.0:1788448347.237997:0:6560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.238019:0:6560:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448347.238389:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876800 00000100:00100000:0.0:1788448347.238396:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876800 00000100:00100000:0.0:1788448347.238440:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788448347.238450:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6560:x1875323926876800:12345-0@lo:502: 00000100:00100000:0.0:1788448347.238769:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6560:x1875323926876800:12345-0@lo:502: Request processed in 318us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448347.238777:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448347.238931:0:6560:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807977100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6560:1875323926876800:0@lo:502: 00000020:01000000:1.0:1788448347.238956:0:6560:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448347.238963:0:6560:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448347.238965:0:6560:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788448347.238970:0:6560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1788448347.239170:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788448347.239232:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448347.239255:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448347.239267:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448347.685030:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448347.744938:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926876928:0@lo:400: 00000100:00100000:0.0:1788448347.745041:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.745178:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926876928 00000100:00100000:1.0:1788448347.745210:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926876928 00000100:00100000:1.0:1788448347.745277:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448347.745289:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3311:x1875323926876928:12345-0@lo:400: 00000100:00100000:1.0:1788448347.754983:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3311:x1875323926876928:12345-0@lo:400: Request processed in 9678us (9924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448347.755011:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448347.755098:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926877056:0@lo:400: 00000100:00100000:1.0:1788448347.755204:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448347.755298:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877056 00000100:00100000:1.0:1788448347.755309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877056 00000100:00100000:1.0:1788448347.755624:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448347.755637:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926877056:12345-0@lo:400: 00000100:00100000:1.0:1788448347.755706:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926877056:12345-0@lo:400: Request processed in 72us (501us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448347.755713:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448347.755759:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a834877100 x1875323926877056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448347.755795:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926877056:0@lo:400: 00000100:00100000:0.0:1788448347.762454:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926876928:0@lo:400: 00010000:00010000:1.0:1788448348.705578:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448349.730220:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788448350.205041:0:6678:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788448350.205046:0:6678:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1788448350.205239:0:6678:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a8092e0800 00000020:01000004:1.0:1788448350.205256:0:6678:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788448350.205270:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1788448350.205283:0:6678:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99a806578000) 00000020:00000080:1.0:1788448350.205299:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788448350.238751:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1788448350.239116:0:6678:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1788448350.271867:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1788448350.281824:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1788448350.281861:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1788448350.281919:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1788448350.281946:0:6678:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1788448350.282596:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1788448350.282607:0:6678:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788448350.282617:0:6678:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd0e9b344b90aac50 00000020:01000004:1.0:1788448350.282625:0:6678:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1788448350.282646:0:6678:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788448350.282650:0:6678:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788448350.282656:0:6678:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1788448350.282660:0:6678:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1788448350.282675:0:6678:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99a80657b370) 00000020:00000080:1.0:1788448350.282685:0:6678:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1788448350.284904:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448350.285120:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448350.285127:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788448350.288965:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448350.288982:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788448350.290137:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448350.290150:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788448350.293357:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448350.293568:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448350.293575:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788448350.296872:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448350.296887:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788448350.331422:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448350.331985:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448350.331992:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788448350.335004:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448350.335018:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788448350.336461:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448350.336473:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788448350.338655:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448350.338859:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788448350.338865:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788448350.340987:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448350.340999:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1788448350.406963:0:6678:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448350.407417:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1788448350.407425:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788448350.410696:0:6678:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448350.410777:0:6678:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788448350.411604:0:6678:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788448350.411648:0:6678:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788448350.411654:0:6678:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788448350.446098:0:6678:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448350.446141:0:6678:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1788448350.446146:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448350.446148:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448350.446149:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448350.446150:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448350.446151:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448350.446153:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448350.446155:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448350.446156:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448350.446158:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448350.446160:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448350.446161:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448350.446165:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1788448350.446168:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448350.446169:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448350.446170:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448350.446171:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448350.446172:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448350.446173:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448350.446174:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448350.446175:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788448350.446176:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788448350.446177:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448350.446177:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448350.446460:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788448350.446481:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926877184:0@lo:253: 00000100:00100000:2.0:1788448350.446638:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.446754:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809332d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.446947:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877184 00000100:00100000:0.0:1788448350.446955:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877184 00000100:00100000:0.0:1788448350.447060:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448350.447069:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926877184:12345-0@lo:253: 20000000:01000000:0.0:1788448350.447108:0:5830:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788448350.447113:0:5830:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1788448350.447118:0:5830:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1788448350.447121:0:5830:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1788448350.448616:0:5830:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448350.448967:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1788448350.448982:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1788448350.449020:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1788448350.449570:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1788448350.449623:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1788448350.449684:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1788448350.450672:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788448350.450694:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:0.0:1788448350.450696:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:0.0:1788448350.450874:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788448350.450883:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788448350.450938:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788448350.450947:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:0.0:1788448350.450977:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788448350.450985:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788448350.451010:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788448350.451380:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1788448350.453065:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788448350.453567:0:5830:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:0.0:1788448350.453570:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:0.0:1788448350.453619:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788448350.453627:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788448350.453656:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788448350.453662:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:0.0:1788448350.453847:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788448350.453860:0:5830:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1788448350.453891:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1788448350.453919:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1788448350.453935:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788448350.453937:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788448350.453941:0:5830:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788448350.453952:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788448350.453955:0:5830:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788448350.453988:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788448350.453990:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788448350.454915:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1788448350.455655:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1788448350.455770:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1788448350.455858:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1788448350.455873:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788448350.455875:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788448350.456985:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:3.0:1788448350.457301:0:6694:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:3.0:1788448350.457373:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788448350.457867:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788448350.457912:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788448350.457966:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788448350.457979:0:5830:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788448350.457982:0:5830:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448350.458779:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448350.458906:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448350.458955:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1788448350.461870:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1788448350.461934:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1788448350.461971:0:5830:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1788448350.461991:0:5830:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1788448350.461994:0:5830:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1788448350.462004:0:5830:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788448350.462388:0:5830:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462409:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462418:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462425:0:5830:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462433:0:5830:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462474:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462560:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.462577:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877312:0@lo:104: 00000100:00100000:0.0:1788448350.462659:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448350.462833:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.462842:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 12 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.462850:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877440:0@lo:104: 00000100:00100000:0.0:1788448350.462870:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448350.463077:0:5830:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.463094:0:5830:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.463102:0:5830:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877568:0@lo:104: 00000100:00100000:0.0:1788448350.463123:0:5830:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.463374:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877312 00000100:00100000:2.0:1788448350.463389:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877312 00000100:00100000:1.0:1788448350.463573:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877440 00000100:00100000:1.0:1788448350.463579:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877440 00000100:00100000:1.0:1788448350.463602:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448350.463611:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:5830:x1875323926877312:12345-0@lo:104: 00010000:00010000:1.0:1788448350.463623:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.463683:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448350.463690:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:5830:x1875323926877312:12345-0@lo:104: Request processed in 81us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.463697:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1788448350.463785:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448350.463793:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.463812:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758c00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448350.463817:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.463827:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448350.463836:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448350.463842:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448350.463874:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.463881:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448350.463898:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.463933:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810758c00/0xd0e9b344b90aabfc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac03 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.463952:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.463963:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.463965:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448350.464304:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448350.464324:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5830:x1875323926877440:12345-0@lo:104: 00010000:00010000:1.0:1788448350.464333:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.464382:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448350.464387:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5830:x1875323926877440:12345-0@lo:104: Request processed in 77us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.464394:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448350.464415:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448350.464428:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926877696:0@lo:103: 00000100:00100000:1.0:1788448350.464458:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448350.464569:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448350.464575:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.464597:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448350.464601:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.464608:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448350.464615:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448350.464620:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448350.464642:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.464649:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448350.464656:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.464663:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aab8c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab93 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.464673:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.464675:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.464677:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448350.464721:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926877824:0@lo:103: 00000100:00100000:1.0:1788448350.464746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448350.464783:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877696 00000100:00100000:1.0:1788448350.464787:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877696 00000100:00100000:2.0:1788448350.464926:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877824 00000100:00100000:2.0:1788448350.464931:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877824 00010000:00010000:2.0:1788448350.464947:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 14 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448350.464969:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448350.464984:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3310:x1875323926877824:12345-0@lo:103: 00010000:00010000:2.0:1788448350.464994:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448350.465000:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 14 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.465010:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 14 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.465026:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448350.465076:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3310:x1875323926877824:12345-0@lo:103: Request processed in 94us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.465091:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788448350.465288:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 13 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448350.465337:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448350.465344:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3310:x1875323926877696:12345-0@lo:103: 00000100:00100000:0.0:1788448350.467274:0:5830:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.467323:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877312:0@lo:104: 00010000:00010000:0.0:1788448350.467338:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800031e00/0xd0e9b344b90aab93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aab8c expref: 13 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.467355:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877440:0@lo:104: 00000100:00100000:0.0:1788448350.467413:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926877824:0@lo:103: 00000100:00100000:2.0:1788448350.467575:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877568 00000100:00100000:2.0:1788448350.467585:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877568 00000100:00100000:2.0:1788448350.467628:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448350.467638:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5830:x1875323926877568:12345-0@lo:104: 00010000:00010000:2.0:1788448350.467654:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.467880:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448350.467887:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5830:x1875323926877568:12345-0@lo:104: Request processed in 251us (4763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.467897:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788448350.467920:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448350.467926:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.467933:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448350.467937:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.467959:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448350.467965:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448350.467970:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448350.468005:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.468012:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448350.468242:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.468249:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90aab70 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aab77 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.468265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.468266:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.468268:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448350.468283:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926877952:0@lo:103: 00000100:00100000:2.0:1788448350.468329:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.468369:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788448350.468377:0:5824:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1788448350.468481:0:5830:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5830:1875323926877568:0@lo:104: 00010000:00010000:0.0:1788448350.468578:0:5830:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.468797:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448350.469008:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.469020:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.469461:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800030e00/0xd0e9b344b90aac03 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aabfc expref: 12 pid: 5829 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.469475:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448350.469575:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926877952 00000100:00100000:2.0:1788448350.469582:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926877952 00010000:00010000:2.0:1788448350.469609:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448350.469639:0:5824:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788448350.469659:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448350.469667:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3311:x1875323926877952:12345-0@lo:103: 00010000:00010000:2.0:1788448350.469679:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448350.469683:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.469693:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448350.469898:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3310:x1875323926877696:12345-0@lo:103: Request processed in 4555us (5439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.469906:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448350.469941:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926877696:0@lo:103: 00010000:00010000:2.0:1788448350.470362:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aab77 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aab70 expref: 12 pid: 5830 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470379:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470387:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470400:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470407:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470414:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470421:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470426:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448350.470431:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.470444:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.470654:0:5830:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.470663:0:5830:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788448350.470671:0:5830:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788448350.482680:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.482701:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800031000/0xd0e9b344b90aac5e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.482728:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448350.483717:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:3311:x1875323926877952:12345-0@lo:103: Request processed in 14030us (15366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.483730:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448350.484424:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926877952:0@lo:103: 00000100:00100000:1.0:1788448350.543480:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:6678:x1875323926877184:12345-0@lo:253: Request processed in 96402us (96832us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.543605:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448350.543786:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926877184:0@lo:253: 10000000:01000000:2.0:1788448350.543860:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788448350.543864:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448350.543865:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448350.543867:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448350.543868:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1788448350.543870:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448350.543871:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448350.543873:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448350.543874:0:6678:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788448350.543876:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448350.543877:0:6678:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448350.543897:0:6678:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a8092e0800 from lustre-OST0000 10000000:01000000:2.0:1788448350.543921:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788448350.543924:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788448350.543930:0:6678:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a8065799b8 local copy 10000000:01000000:2.0:1788448350.543934:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788448350.543966:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.543977:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.544004:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448350.544021:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878080:0@lo:101: 00000100:00100000:3.0:1788448350.544559:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448350.544923:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448350.544975:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878080 00000100:00100000:1.0:1788448350.544983:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878080 00000100:00100000:1.0:1788448350.545274:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448350.545285:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:6678:x1875323926878080:12345-0@lo:101: 00010000:00010000:1.0:1788448350.545300:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448350.545326:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629600/0xd0e9b344b90aac6c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac65 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.545350:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629600/0xd0e9b344b90aac6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac65 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.545361:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629600/0xd0e9b344b90aac6c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac65 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.545369:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629600, rc 0) 00000100:00100000:1.0:1788448350.545408:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:6678:x1875323926878080:12345-0@lo:101: Request processed in 125us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.545414:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448350.545508:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878080:0@lo:101: 00010000:00010000:0.0:1788448350.545523:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.545539:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.545638:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878208:0@lo:501: 00000100:00100000:0.0:1788448350.545665:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.546453:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.546649:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878208 00000100:00100000:3.0:1788448350.546656:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878208 00000100:00100000:3.0:1788448350.546690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448350.546698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:6678:x1875323926878208:12345-0@lo:501: 00000100:00100000:3.0:1788448350.547067:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:6678:x1875323926878208:12345-0@lo:501: Request processed in 367us (1399us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448350.547075:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448350.547201:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878208:0@lo:501: 10000000:01000000:0.0:1788448350.547219:0:6678:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788448350.547255:0:6678:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788448350.547262:0:6678:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.547271:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.547278:0:6678:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.547300:0:6678:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788448350.547336:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a8092e0800 10000000:01000000:0.0:1788448350.547342:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788448350.547346:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99a8065799b8 10000000:01000000:0.0:1788448350.547349:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1788448350.547353:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99a8065799b8 from 1 10000000:01000000:0.0:1788448350.547356:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1788448350.547382:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.547401:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.547411:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.547437:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878336:0@lo:101: 00000100:00100000:0.0:1788448350.547471:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.547493:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.547854:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878336 00000100:00100000:3.0:1788448350.547860:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878336 00000100:00100000:3.0:1788448350.547885:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788448350.547892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+10:6678:x1875323926878336:12345-0@lo:101: 00010000:00010000:3.0:1788448350.547902:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448350.547915:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810759400/0xd0e9b344b90aac7a lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac73 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.547935:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810759400/0xd0e9b344b90aac7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac73 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.547946:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810759400/0xd0e9b344b90aac7a lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac73 expref: 11 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.547966:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759400, rc 0) 00000100:00100000:3.0:1788448350.548008:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:6678:x1875323926878336:12345-0@lo:101: Request processed in 116us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.548014:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788448350.548319:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878336:0@lo:101: 00010000:00010000:0.0:1788448350.548334:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.548343:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448350.548359:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788448350.548376:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.548383:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448350.548389:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788448350.548393:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788448350.548398:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788448350.548400:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788448350.548415:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.548438:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.548446:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.548458:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878464:0@lo:101: 00000100:00100000:0.0:1788448350.548600:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.548628:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448350.548697:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878464 00000100:00100000:1.0:1788448350.548804:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878464 00000100:00100000:1.0:1788448350.548834:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788448350.548842:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:6678:x1875323926878464:12345-0@lo:101: 00010000:00010000:1.0:1788448350.548851:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448350.548861:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac81 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.548877:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.548885:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.548904:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:1.0:1788448350.548944:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878464:12345-0@lo:101: Request processed in 103us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.548950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448350.549245:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878464:0@lo:101: 00010000:00010000:0.0:1788448350.549258:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.549267:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.549365:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878592:0@lo:501: 00000100:00100000:0.0:1788448350.549389:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.549413:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.549576:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878592 00000100:00100000:3.0:1788448350.549581:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878592 00000100:00100000:3.0:1788448350.549600:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448350.549606:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878592:12345-0@lo:501: 00000100:00100000:3.0:1788448350.549882:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878592:12345-0@lo:501: Request processed in 275us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.549889:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448350.549955:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878592:0@lo:501: 00000100:00100000:0.0:1788448350.549979:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878720:0@lo:503: 00000100:00100000:0.0:1788448350.550010:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.550034:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.550282:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878720 00000100:00100000:3.0:1788448350.550287:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878720 00000100:00100000:3.0:1788448350.550303:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448350.550320:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878720:12345-0@lo:503: 00000100:00100000:3.0:1788448350.550561:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878720:12345-0@lo:503: Request processed in 251us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.550567:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788448350.550670:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878720:0@lo:503: 00000040:00080000:0.0:1788448350.550970:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448350.551258:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878848:0@lo:502: 00000100:00100000:0.0:1788448350.551290:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.551330:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.551410:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878848 00000100:00100000:3.0:1788448350.551414:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878848 00000100:00100000:3.0:1788448350.551558:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448350.551566:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878848:12345-0@lo:502: 00000100:00100000:3.0:1788448350.551698:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878848:12345-0@lo:502: Request processed in 133us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.551844:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788448350.551915:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878848:0@lo:502: 00000040:00080000:0.0:1788448350.552295:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788448350.552349:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788448350.552377:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788448350.552412:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788448350.552865:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788448350.552908:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788448350.552943:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878976:0@lo:502: 00000100:00100000:0.0:1788448350.552992:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.553226:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7900 going to sleep for 11 seconds 00000100:00100000:2.0:1788448350.553351:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926878976 00000100:00100000:2.0:1788448350.553358:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926878976 00000100:00100000:1.0:1788448350.553558:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788448350.553569:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878976:12345-0@lo:502: 00000100:00100000:1.0:1788448350.553881:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926878976:12345-0@lo:502: Request processed in 314us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448350.553889:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448350.553996:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926878976:0@lo:502: 00000040:00080000:0.0:1788448350.554297:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1788448350.554321:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00010000:00010000:2.0:1788448350.555008:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448350.555018:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555039:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448350.555043:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555061:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448350.555068:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448350.555074:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448350.555248:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555257:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448350.555276:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555284:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842178000/0xd0e9b344b90aac65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aac6c expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555305:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.555318:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448350.555320:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448350.555609:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926879104:0@lo:103: 00000100:00100000:1.0:1788448350.555660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.555783:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879104 00000100:00100000:2.0:1788448350.555791:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879104 00000100:00100000:2.0:1788448350.555850:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448350.555859:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3312:x1875323926879104:12345-0@lo:103: 00010000:00010000:2.0:1788448350.555870:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448350.555884:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629600/0xd0e9b344b90aac6c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aac65 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.555897:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448350.555928:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:3312:x1875323926879104:12345-0@lo:103: Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.555935:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448350.556019:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926879104:0@lo:103: 00000020:01000000:1.0:1788448350.556953:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448350.556961:0:6698:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1788448350.556967:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448350.556970:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788448350.556975:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448350.557004:0:6698:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99a704c58000) 00000020:00000080:1.0:1788448350.557246:0:6698:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788448350.557255:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788448350.557334:0:6698:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a8092e0800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788448350.557341:0:6698:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448350.557347:0:6698:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd0e9b344b90aac96 00010000:00010000:3.0:1788448350.565289:0:6698:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1788448350.565891:0:6698:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1788448350.570174:0:6698:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788448350.570715:0:6698:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1788448350.582043:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1788448350.583384:0:6698:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1788448350.585242:0:6698:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788448350.585253:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448350.585258:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448350.585261:0:6698:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788448350.585263:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448350.585267:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448350.585268:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788448350.585271:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788448350.585273:0:6698:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788448350.585329:0:6698:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448350.585332:0:6698:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448350.585334:0:6698:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788448350.585337:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1788448350.585474:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1788448350.585506:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788448350.585523:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.585535:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448350.585544:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a8092e0800 from 1 10000000:01000000:0.0:1788448350.585546:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448350.585577:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.585596:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.585607:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.585629:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879232:0@lo:101: 00000100:00100000:0.0:1788448350.585687:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.585843:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448350.585989:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879232 00000100:00100000:2.0:1788448350.585996:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879232 00000100:00100000:2.0:1788448350.586037:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788448350.586045:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:6678:x1875323926879232:12345-0@lo:101: 00010000:00010000:2.0:1788448350.586057:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448350.586069:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aac9d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.586152:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.586164:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448350.586204:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178000, rc 0) 00000100:00100000:2.0:1788448350.586240:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879232:12345-0@lo:101: Request processed in 196us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.586247:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448350.586594:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879232:0@lo:101: 00010000:00010000:0.0:1788448350.586608:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.586617:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.586762:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879360:0@lo:501: 00000100:00100000:0.0:1788448350.586792:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.586883:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.586900:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879360 00000100:00100000:0.0:1788448350.586903:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879360 00000100:00100000:0.0:1788448350.586934:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448350.586941:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879360:12345-0@lo:501: 00000100:00100000:0.0:1788448350.587409:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879360:12345-0@lo:501: Request processed in 466us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448350.587416:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788448350.587617:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879360:0@lo:501: 00000100:00100000:2.0:1788448350.587647:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879488:0@lo:503: 00000100:00100000:2.0:1788448350.587682:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.587780:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.587955:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879488 00000100:00100000:3.0:1788448350.587961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879488 00000100:00100000:3.0:1788448350.587998:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448350.588006:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879488:12345-0@lo:503: 00000100:00100000:3.0:1788448350.588905:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879488:12345-0@lo:503: Request processed in 896us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.588913:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788448350.597655:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879488:0@lo:503: 00000040:00080000:3.0:1788448350.598638:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448350.599592:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879616:0@lo:502: 00000100:00100000:3.0:1788448350.599680:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448350.599896:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.599934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879616 00000100:00100000:0.0:1788448350.599942:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879616 00000100:00100000:0.0:1788448350.599997:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448350.600015:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879616:12345-0@lo:502: 00000100:00100000:0.0:1788448350.600243:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879616:12345-0@lo:502: Request processed in 228us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448350.600251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448350.600286:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879616:0@lo:502: 00000040:00080000:3.0:1788448350.600593:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1788448350.600653:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1788448350.600683:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879744:0@lo:502: 00000100:00100000:3.0:1788448350.600956:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448350.601001:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448350.601433:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879744 00000100:00100000:2.0:1788448350.601441:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879744 00000100:00100000:2.0:1788448350.601488:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448350.601497:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879744:12345-0@lo:502: 00000100:00100000:2.0:1788448350.601674:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879744:12345-0@lo:502: Request processed in 178us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.601682:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448350.601908:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879744:0@lo:502: 00000040:00080000:3.0:1788448350.602052:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788448350.602065:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1788448350.604353:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448350.604366:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448350.604369:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788448350.604376:0:6702:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a8092e0800 00000020:00000080:2.0:1788448350.604378:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788448350.604399:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448350.604403:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448350.604404:0:6702:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1788448350.604407:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1788448350.604506:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1788448350.604531:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448350.604554:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.604567:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448350.604606:0:6678:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448350.604609:0:6678:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a8092e0800 10000000:01000000:3.0:1788448350.604613:0:6678:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a8092e0800 10000000:01000000:3.0:1788448350.604618:0:6678:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448350.604624:0:6678:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a8092e0800 from 1 10000000:01000000:3.0:1788448350.604626:0:6678:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448350.604661:0:6678:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.604670:0:6678:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.604681:0:6678:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448350.604897:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879872:0@lo:101: 00000100:00100000:3.0:1788448350.604959:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.605008:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926879872 00000100:00100000:3.0:1788448350.605009:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.605015:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926879872 00000100:00100000:0.0:1788448350.605068:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448350.605078:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926879872:12345-0@lo:101: 00010000:00010000:0.0:1788448350.605091:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448350.605104:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aacab expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.605125:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.605135:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.605144:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030c00, rc 0) 00000100:00100000:0.0:1788448350.605212:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926879872:12345-0@lo:101: Request processed in 135us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448350.605218:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788448350.605287:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926879872:0@lo:101: 00010000:00010000:3.0:1788448350.605301:0:6678:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448350.605320:0:6678:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448350.605434:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880000:0@lo:501: 00000100:00100000:3.0:1788448350.605459:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448350.605493:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448350.605494:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880000 00000100:00100000:2.0:1788448350.605505:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880000 00000100:00100000:2.0:1788448350.605535:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448350.605542:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880000:12345-0@lo:501: 00000100:00100000:2.0:1788448350.605769:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880000:12345-0@lo:501: Request processed in 226us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.605776:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448350.605786:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880000:0@lo:501: 00000100:00100000:3.0:1788448350.605880:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880128:0@lo:503: 00000100:00100000:3.0:1788448350.605915:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448350.605935:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448350.606096:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880128 00000100:00100000:2.0:1788448350.606101:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880128 00000100:00100000:2.0:1788448350.606166:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448350.606175:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880128:12345-0@lo:503: 00000100:00100000:2.0:1788448350.606362:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880128:12345-0@lo:503: Request processed in 188us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.606370:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788448350.606490:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880128:0@lo:503: 00000040:00080000:0.0:1788448350.606770:0:6678:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448350.606830:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880256:0@lo:502: 00000100:00100000:0.0:1788448350.606873:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.607666:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.607705:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880256 00000100:00100000:3.0:1788448350.607712:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880256 00000100:00100000:3.0:1788448350.607745:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788448350.607752:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880256:12345-0@lo:502: 00000100:00100000:3.0:1788448350.607976:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880256:12345-0@lo:502: Request processed in 224us (1102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.607984:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788448350.610560:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880256:0@lo:502: 00000040:00080000:0.0:1788448350.610904:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1788448350.610969:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1788448350.611004:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1788448350.612209:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1788448350.612250:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1788448350.612289:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1788448350.612334:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1788448350.612362:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1788448350.612400:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1788448350.612430:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1788448350.612460:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1788448350.612501:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1788448350.612533:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1788448350.612561:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1788448350.612618:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1788448350.612654:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1788448350.612683:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1788448350.612736:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1788448350.612772:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1788448350.612823:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1788448350.612875:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1788448350.612911:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1788448350.612943:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1788448350.612987:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1788448350.613018:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1788448350.614568:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1788448350.614663:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1788448350.614701:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1788448350.614765:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880384:0@lo:502: 00000100:00100000:0.0:1788448350.614844:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.614929:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448350.615360:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880384 00000100:00100000:1.0:1788448350.615376:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880384 00000100:00100000:3.0:1788448350.615827:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788448350.615848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880384:12345-0@lo:502: 00000100:00100000:3.0:1788448350.616410:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880384:12345-0@lo:502: Request processed in 561us (1562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.616419:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788448350.616505:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880384:0@lo:502: 00000040:00080000:0.0:1788448350.616606:0:6678:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1788448350.616620:0:6678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1788448350.617842:0:6703:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788448350.617858:0:6703:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99a83e70cd28) 00000020:00000080:3.0:1788448350.617878:0:6703:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:3.0:1788448350.617961:0:6703:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a8092e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448350.617965:0:6703:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a8092e0800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788448350.617968:0:6703:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a8092e0800 3 00010000:00080000:3.0:1788448350.617995:0:6703:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a704f19000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448350.621987:0:6703:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1788448350.622178:0:6703:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788448350.622267:0:6703:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448350.622281:0:6703:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd0e9b344b90aacc0 00000100:00080000:3.0:1788448350.622291:0:6703:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448350.622299:0:6703:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a704f19000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448350.622349:0:6703:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a834874000 x1875323926880512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448350.622376:0:6703:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788448350.624632:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926880512:0@lo:38: 00000100:00100000:0.0:1788448350.624716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.625040:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926880640:0@lo:400: 00000100:00100000:0.0:1788448350.625068:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448350.625154:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880512 00000100:00100000:2.0:1788448350.625162:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880512 00000100:00100000:2.0:1788448350.625214:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880640 00000100:00100000:2.0:1788448350.625218:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880640 00000100:00100000:2.0:1788448350.625244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448350.625254:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926880640:12345-0@lo:400: 00000100:00100000:2.0:1788448350.625318:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926880640:12345-0@lo:400: Request processed in 55us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.625325:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448350.625341:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448350.625345:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875323926880512:12345-0@lo:38: 00010000:00080000:2.0:1788448350.625366:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:2.0:1788448350.625397:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd0e9b344b90aacc7 00000004:00100000:2.0:1788448350.625411:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448350.625448:0:5839:0:(import.c:65:import_set_state_nolock()) ffff99a7047ef000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448350.625488:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875323926880512:12345-0@lo:38: Request processed in 141us (773us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448350.625495:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448350.625530:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a8359d6680 x1875323926880640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448366 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448350.625545:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926880640:0@lo:400: 00010000:00080000:2.0:1788448350.625572:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a834874000 x1875323926880512/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448360 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448350.625580:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448350.625586:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1788448350.625592:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448350.625596:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448350.625598:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a704f19000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448350.625603:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926880512:0@lo:38: 00000040:00080000:2.0:1788448350.630833:0:6703:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1788448350.634296:0:6678:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1788448350.634349:0:6678:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448350.634392:0:6678:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.634405:0:6678:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788448350.634460:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788448350.634463:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448350.634464:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448350.634465:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448350.634467:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448350.634468:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448350.634469:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448350.634471:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448350.634473:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448350.634474:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448350.634475:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448350.634480:0:6678:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1788448350.634482:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788448350.634483:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448350.634484:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448350.634485:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448350.634486:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448350.634488:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448350.634489:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448350.634489:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448350.634490:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448350.634491:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448350.634492:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448350.634532:0:6678:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788448350.634552:0:6678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880768:0@lo:253: 00000100:00100000:1.0:1788448350.634620:0:6678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448350.634670:0:6678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448350.634775:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880768 00000100:00100000:3.0:1788448350.634783:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880768 00000100:00100000:3.0:1788448350.634834:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448350.634843:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6678:x1875323926880768:12345-0@lo:253: 20000000:01000000:3.0:1788448350.634879:0:5829:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788448350.634893:0:5829:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788448350.667395:0:5829:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788448350.667413:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788448350.667586:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788448350.667591:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788448350.667613:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.667636:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.667645:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.667682:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448350.667696:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 13 pid: 5831 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448350.667711:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926880896:0@lo:104: 00000100:00100000:1.0:1788448350.667850:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448350.667906:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448350.668143:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926880896 00000100:00100000:0.0:1788448350.668150:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926880896 00000100:00100000:0.0:1788448350.668220:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448350.668231:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926880896:12345-0@lo:104: 00010000:00010000:0.0:1788448350.668243:0:5820:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668296:0:5820:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448350.668302:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926880896:12345-0@lo:104: Request processed in 75us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448350.668321:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788448350.668341:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448350.668347:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668353:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448350.668356:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668372:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448350.668378:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448350.668383:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448350.668411:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668418:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448350.668505:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668513:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90aac26 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac2d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668529:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448350.668531:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448350.668532:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448350.668552:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926881024:0@lo:103: 00000100:00100000:0.0:1788448350.668585:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448350.668619:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881024 00000100:00100000:0.0:1788448350.668623:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881024 00010000:00010000:0.0:1788448350.668639:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 14 pid: 5831 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.668661:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448350.668667:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804614850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3310:x1875323926881024:12345-0@lo:103: 00010000:00010000:0.0:1788448350.668685:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448350.668691:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 14 pid: 5831 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668702:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 14 pid: 5831 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668717:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668724:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788448350.668737:0:6696:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001146956s 00010000:00010000:0.0:1788448350.668741:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668747:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668754:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668760:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668766:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448350.668770:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.668777:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.669251:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.669262:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448350.669295:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804614850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3310:x1875323926881024:12345-0@lo:103: Request processed in 627us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448350.669302:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1788448350.669378:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810628600/0xd0e9b344b90aac2d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aac26 expref: 13 pid: 5831 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448350.669390:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926880896:0@lo:104: 00010000:00010000:0.0:1788448350.669405:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.669413:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448350.669932:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926881024:0@lo:103: 00010000:00010000:0.0:1788448350.670840:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448350.670857:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629600/0xd0e9b344b90aacce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448350.677691:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:6678:x1875323926880768:12345-0@lo:253: Request processed in 42840us (43062us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448350.677706:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448350.677805:0:6678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:6678:1875323926880768:0@lo:253: 10000000:01000000:0.0:1788448350.677822:0:6678:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788448350.677826:0:6678:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448350.677827:0:6678:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448350.677829:0:6678:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448350.677830:0:6678:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448350.677842:0:6678:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448350.677843:0:6678:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448350.677844:0:6678:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448350.677846:0:6678:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448350.677847:0:6678:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448350.677849:0:6678:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448350.677850:0:6678:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448350.677865:0:6678:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788448350.686964:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448350.687313:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788448350.687598:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448350.687796:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788448350.687994:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448350.688938:0:6678:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788448350.690521:0:6678:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:0.0:1788448350.754364:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788448350.948041:0:6678:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788448350.948048:0:6678:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788448350.948081:0:6678:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788448350.948135:0:6678:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788448350.948150:0:6678:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788448350.948175:0:6678:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788448351.776618:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448352.802627:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448353.837703:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448354.401333:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788448354.401343:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80badd000 from 21 10000000:01000000:2.0:1788448354.401349:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448354.401403:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448354.401423:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448354.401435:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448354.401459:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881152:0@lo:101: 00000100:00100000:2.0:1788448354.401529:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448354.401589:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80799af00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.401670:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881152 00000100:00100000:3.0:1788448354.401678:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881152 00000100:00100000:3.0:1788448354.401745:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448354.401755:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926881152:12345-0@lo:101: 00010000:00010000:3.0:1788448354.401780:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448354.401794:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aacd5 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.401819:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.401830:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.401839:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759000, rc 0) 00000100:00100000:3.0:1788448354.401879:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881152:12345-0@lo:101: Request processed in 125us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.401885:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448354.401928:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881152:0@lo:101: 00010000:00010000:3.0:1788448354.401941:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.401950:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448354.402013:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881280:0@lo:501: 00000100:00100000:3.0:1788448354.402037:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.402050:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.402063:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881280 00000100:00100000:3.0:1788448354.402067:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881280 00000100:00100000:3.0:1788448354.402086:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448354.402092:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881280:12345-0@lo:501: 00000100:00100000:3.0:1788448354.402472:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881280:12345-0@lo:501: Request processed in 378us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.402479:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448354.402509:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881280:0@lo:501: 00000100:00100000:3.0:1788448354.402535:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881408:0@lo:503: 00000100:00100000:3.0:1788448354.402571:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.402585:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.402596:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881408 00000100:00100000:3.0:1788448354.402599:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881408 00000100:00100000:3.0:1788448354.402620:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448354.402626:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881408:12345-0@lo:503: 00000100:00100000:3.0:1788448354.402899:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881408:12345-0@lo:503: Request processed in 272us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.402906:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448354.403030:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881408:0@lo:503: 00000100:00100000:3.0:1788448354.403226:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6875:1875323926881536:0@lo:502: 00000100:00100000:3.0:1788448354.403270:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.403300:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881536 00000100:00100000:3.0:1788448354.403304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881536 00000100:00100000:3.0:1788448354.403328:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448354.403335:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6875:x1875323926881536:12345-0@lo:502: 00000100:00100000:3.0:1788448354.403514:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6875:x1875323926881536:12345-0@lo:502: Request processed in 180us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.403521:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788448354.403554:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.403565:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6875:1875323926881536:0@lo:502: 00000100:00100000:3.0:1788448354.403601:0:6875:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6875:1875323926881664:0@lo:502: 00000100:00100000:3.0:1788448354.403630:0:6875:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.403647:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881664 00000100:00100000:3.0:1788448354.403650:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881664 00000100:00100000:3.0:1788448354.403669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448354.403674:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6875:x1875323926881664:12345-0@lo:502: 00000100:00100000:3.0:1788448354.403774:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:6875:x1875323926881664:12345-0@lo:502: Request processed in 99us (142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.403781:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448354.403807:0:6875:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.403818:0:6875:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6875:1875323926881664:0@lo:502: 00000040:00080000:3.0:1788448354.403836:0:6875:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1788448354.403876:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1788448354.403890:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448354.403897:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.403906:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448354.403924:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788448354.403927:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a80badd000 from 4 10000000:01000000:3.0:1788448354.403930:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788448354.403953:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.403959:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.403966:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448354.403976:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881792:0@lo:101: 00000100:00100000:3.0:1788448354.403999:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.404011:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.404021:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881792 00000100:00100000:3.0:1788448354.404024:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881792 00000100:00100000:3.0:1788448354.404044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448354.404050:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926881792:12345-0@lo:101: 00010000:00010000:3.0:1788448354.404058:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448354.404068:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aace3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.404086:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.404095:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.404114:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:3.0:1788448354.404144:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926881792:12345-0@lo:101: Request processed in 94us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.404150:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448354.404178:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881792:0@lo:101: 00010000:00010000:3.0:1788448354.404210:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.404220:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448354.404273:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881920:0@lo:256: 00000100:00100000:3.0:1788448354.404300:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.404314:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.404326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926881920 00000100:00100000:3.0:1788448354.404329:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926881920 00000100:00100000:3.0:1788448354.404350:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448354.404356:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926881920:12345-0@lo:256: 20000000:01000000:3.0:1788448354.404368:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448354.404384:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448354.404388:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1788448354.404461:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926881920:12345-0@lo:256: Request processed in 105us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.404467:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448354.404495:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926881920:0@lo:256: 10000000:01000000:3.0:1788448354.407848:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448354.407869:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.407881:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448354.407890:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788448354.407893:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1788448354.407896:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788448354.407929:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.407937:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448354.407947:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448354.407967:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882048:0@lo:101: 00000100:00100000:3.0:1788448354.408029:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.408079:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448354.408275:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882048 00000100:00100000:1.0:1788448354.408284:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882048 00000100:00100000:1.0:1788448354.408332:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448354.408342:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926882048:12345-0@lo:101: 00010000:00010000:1.0:1788448354.408356:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448354.408369:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aacf1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.408389:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.408421:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.408432:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:1.0:1788448354.408475:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926882048:12345-0@lo:101: Request processed in 134us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.408482:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788448354.408523:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882048:0@lo:101: 00010000:00010000:1.0:1788448354.408536:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.408545:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448354.408589:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882176:0@lo:501: 00000100:00100000:1.0:1788448354.408612:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.408631:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.408862:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882176 00000100:00100000:3.0:1788448354.408867:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882176 00000100:00100000:3.0:1788448354.408889:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448354.408895:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926882176:12345-0@lo:501: 00000100:00100000:3.0:1788448354.409136:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926882176:12345-0@lo:501: Request processed in 240us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.409143:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448354.409174:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807977b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882176:0@lo:501: 00000100:00100000:3.0:1788448354.409229:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882304:0@lo:503: 00000100:00100000:3.0:1788448354.409278:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.409292:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2acc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.409303:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882304 00000100:00100000:3.0:1788448354.409306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882304 00000100:00100000:3.0:1788448354.409324:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448354.409329:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926882304:12345-0@lo:503: 00000100:00100000:3.0:1788448354.409600:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926882304:12345-0@lo:503: Request processed in 269us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.409607:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448354.409645:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926882304:0@lo:503: 00000100:00100000:3.0:1788448354.409939:0:6876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6876:1875323926882432:0@lo:502: 00000100:00100000:3.0:1788448354.409970:0:6876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448354.409988:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882432 00000100:00100000:3.0:1788448354.409991:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882432 00000100:00100000:3.0:1788448354.410008:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448354.410014:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:6876:x1875323926882432:12345-0@lo:502: 00000100:00100000:3.0:1788448354.410220:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:6876:x1875323926882432:12345-0@lo:502: Request processed in 204us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.410226:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448354.410267:0:6876:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.410279:0:6876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6876:1875323926882432:0@lo:502: 00000020:01000000:3.0:1788448354.410300:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448354.410308:0:6876:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788448354.410314:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448354.410322:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788448354.410327:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448354.410331:0:6876:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:3.0:1788448354.410355:0:6876:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788448354.410358:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448354.410375:0:6876:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99a83e708000) 00000020:00000080:3.0:1788448354.410393:0:6876:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:3.0:1788448354.410399:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448354.410856:0:6876:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788448354.410862:0:6876:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788448354.410869:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aad06 00010000:00080000:3.0:1788448354.410900:0:6876:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a83d43a800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448354.411138:0:6876:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788448354.462336:0:6876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788448354.462372:0:6876:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788448354.462957:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448354.463121:0:6876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448354.463172:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:3.0:1788448354.463518:0:6876:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788448354.467077:0:6879:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448354.467085:0:6879:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1788448354.467907:0:6876:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448354.467919:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788448354.467952:0:6876:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788448354.467973:0:6876:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90aad0d 00000100:00080000:1.0:1788448354.467983:0:6876:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448354.467990:0:6876:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a83d43a800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448354.468026:0:6876:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a807976300 x1875323926882560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448354.468056:0:6876:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1788448354.468124:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448354.468128:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448354.468130:0:6876:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1788448354.468133:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448354.468137:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448354.468138:0:6876:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448354.468141:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448354.468143:0:6876:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788448354.468173:0:6876:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6876:1875323926882688:0@lo:502: 00000100:00100000:1.0:1788448354.468296:0:6876:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.468339:0:6876:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80aff16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448354.468461:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926882560:0@lo:8: 00000100:00100000:0.0:1788448354.468499:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448354.468539:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882560 00000100:00100000:0.0:1788448354.468547:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882560 00000100:00100000:0.0:1788448354.468582:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448354.468589:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875323926882560:12345-0@lo:8: 00010000:00080000:0.0:1788448354.468612:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:0.0:1788448354.468650:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90aad14 00002000:00100000:0.0:1788448354.468682:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99a704c37000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788448354.468686:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:0.0:1788448354.468691:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788448354.468820:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788448354.468959:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788448354.468981:0:6680:0:(import.c:65:import_set_state_nolock()) ffff99a704c30800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448354.469036:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875323926882560:12345-0@lo:8: Request processed in 446us (536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448354.469044:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788448354.469095:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807976300 x1875323926882560/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448354.469106:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448354.469114:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788448354.469120:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788448354.469126:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788448354.469129:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83d43a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788448354.469137:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788448354.469143:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926882560:0@lo:8: 00000004:00080000:0.0:1788448354.469165:0:6879:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788448354.469296:0:6879:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 215076109434ns, next at 0ns, rc = 0 00000100:00100000:1.0:1788448354.469499:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882688 00000100:00100000:1.0:1788448354.469504:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882688 00000100:00100000:1.0:1788448354.469533:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448354.469541:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:6876:x1875323926882688:12345-0@lo:502: 00000100:00100000:1.0:1788448354.469739:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:6876:x1875323926882688:12345-0@lo:502: Request processed in 197us (1442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.469746:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448354.469812:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926882944:0@lo:400: 00000100:00100000:1.0:1788448354.469843:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.469866:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448354.469871:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926882816:0@lo:400: 00000100:00100000:1.0:1788448354.469891:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.470166:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882944 00000100:00100000:1.0:1788448354.470172:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882944 00000100:00100000:1.0:1788448354.470264:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926882816 00000100:00100000:1.0:1788448354.470268:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926882816 00000100:00100000:1.0:1788448354.470284:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448354.470291:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926882944:12345-0@lo:400: 00000100:00100000:1.0:1788448354.470341:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926882944:12345-0@lo:400: Request processed in 50us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.471049:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448354.471072:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448354.471081:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926882816:12345-0@lo:400: 00000100:00100000:1.0:1788448354.471124:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926882816:12345-0@lo:400: Request processed in 46us (1232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.471131:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788448354.471171:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448354.471250:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807975880 x1875323926882816/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448354.471267:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926882816:0@lo:400: 00010000:00080000:1.0:1788448354.471280:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807975f80 x1875323926882944/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448370 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448354.471289:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926882944:0@lo:400: 00000100:00100000:1.0:1788448354.471324:0:6876:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:6876:1875323926882688:0@lo:502: 00000020:01000000:1.0:1788448354.471377:0:6876:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448354.471384:0:6876:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448354.471386:0:6876:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788448354.471390:0:6876:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1788448354.474136:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1788448354.474172:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788448354.474208:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448354.474223:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448354.474246:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788448354.474250:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a8065799b8 from 1 10000000:01000000:0.0:1788448354.474253:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448354.474296:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448354.474306:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448354.474319:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448354.474351:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926883072:0@lo:101: 00000100:00100000:0.0:1788448354.474419:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448354.474469:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a810d1e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448354.476075:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883072 00000100:00100000:1.0:1788448354.476093:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883072 00000100:00100000:1.0:1788448354.476141:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448354.476152:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926883072:12345-0@lo:101: 00010000:00010000:1.0:1788448354.476167:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448354.476210:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aad1b expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.476247:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.476258:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.476266:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628c00, rc 0) 00000100:00100000:1.0:1788448354.476339:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926883072:12345-0@lo:101: Request processed in 189us (1919us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.476346:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448354.476589:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926883072:0@lo:101: 00010000:00010000:1.0:1788448354.476607:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.476617:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448354.476688:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926883200:0@lo:501: 00000100:00100000:1.0:1788448354.476719:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.476795:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeae40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448354.485570:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883200 00000100:00100000:2.0:1788448354.485588:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883200 00000100:00100000:2.0:1788448354.485646:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448354.485657:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926883200:12345-0@lo:501: 00000100:00100000:2.0:1788448354.485938:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926883200:12345-0@lo:501: Request processed in 281us (9217us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788448354.485946:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788448354.487316:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926883200:0@lo:501: 10000000:01000000:1.0:1788448354.487377:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788448354.487390:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448354.487403:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448354.540720:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788448354.564761:0:6880:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788448354.564791:0:6880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883456:0@lo:7: 00000100:00100000:1.0:1788448354.564863:0:6880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.564913:0:6880:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.565009:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926883328:0@lo:13: 00000100:00100000:3.0:1788448354.565041:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.565135:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883328 00000100:00100000:1.0:1788448354.565142:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883328 00000100:00100000:1.0:1788448354.565218:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448354.565228:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926883328:12345-0@lo:13: 00002000:00000024:1.0:1788448354.565269:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1788448354.565309:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926883328:12345-0@lo:13: Request processed in 84us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448354.565316:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:3.0:1788448354.565633:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448354.565660:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807974700 x1875323926883328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448370 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448354.565677:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926883328:0@lo:13: 00000100:00100000:2.0:1788448354.565766:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883456 00000100:00100000:2.0:1788448354.565770:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883456 00000100:00100000:2.0:1788448354.565832:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448354.565840:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6880:x1875323926883456:12345-0@lo:7: 00002000:00080000:3.0:1788448354.573281:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1788448354.573290:0:6683:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788448354.573608:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6880:x1875323926883456:12345-0@lo:7: Request processed in 7763us (8739us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.573620:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448354.573716:0:6880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807975f80 x1875323926883456/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448354.573733:0:6880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883456:0@lo:7: 00000004:00080000:1.0:1788448354.573747:0:6880:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1788448354.573786:0:6880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883584:0@lo:5: 00000100:00100000:1.0:1788448354.573823:0:6880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.573931:0:6880:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.574113:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883584 00000100:00100000:3.0:1788448354.574122:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883584 00000100:00100000:3.0:1788448354.574290:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448354.574302:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6880:x1875323926883584:12345-0@lo:5: 00002000:00080000:3.0:1788448354.574332:0:6682:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1788448354.574336:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1788448354.574767:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6880:x1875323926883584:12345-0@lo:5: Request processed in 467us (942us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788448354.574775:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788448354.574923:0:6880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807975f80 x1875323926883584/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448354.574937:0:6880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883584:0@lo:5: 00000004:00080000:1.0:1788448354.574949:0:6880:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1788448354.574979:0:6880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883712:0@lo:700: 00000100:00100000:1.0:1788448354.575018:0:6880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.575057:0:6880:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448354.575201:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883712 00000100:00100000:0.0:1788448354.575207:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883712 00000100:00100000:0.0:1788448354.575294:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448354.575304:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6880:x1875323926883712:12345-0@lo:700: 00000100:00100000:0.0:1788448354.575701:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875323926883840:0@lo:700: 00000100:00100000:0.0:1788448354.575732:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448354.575765:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808805a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448354.575857:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883840 00000100:00100000:1.0:1788448354.575861:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883840 00000100:00100000:1.0:1788448354.575893:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448354.575900:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875323926883840:12345-0@lo:700: 40000000:02000000:2.0:1788448354.604720:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1788448354.609935:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6689:x1875323926883840:12345-0@lo:700: Request processed in 34024us (34190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.609955:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788448354.610152:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8079a7100 x1875323926883840/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788448370 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448354.610168:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6689:1875323926883840:0@lo:700: 40000000:02000000:0.0:1788448354.610182:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:2.0:1788448354.678547:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1788448354.678700:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:3.0:1788448354.678781:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6880:x1875323926883712:12345-0@lo:700: Request processed in 103473us (103756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448354.678799:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788448354.678954:0:6880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807976300 x1875323926883712/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448354.678973:0:6880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883712:0@lo:700: 00000004:02000040:1.0:1788448354.701652:0:6880:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1788448354.705534:0:6880:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883968:0@lo:5: 00000100:00100000:1.0:1788448354.705606:0:6880:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448354.705704:0:6880:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448354.705739:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926883968 00000100:00100000:3.0:1788448354.705748:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926883968 00000100:00100000:3.0:1788448354.705804:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448354.705814:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6880:x1875323926883968:12345-0@lo:5: 00002000:00080000:3.0:1788448354.711862:0:6683:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1788448354.711883:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1788448354.714789:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6880:x1875323926883968:12345-0@lo:5: Request processed in 8970us (9177us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788448354.714802:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788448354.714939:0:6880:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807976a00 x1875323926883968/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448370 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448354.714954:0:6880:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788448354.714973:0:6880:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99a807976a00 x1875323926883968/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448370 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448354.714987:0:6880:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6880:1875323926883968:0@lo:5: 00000004:00080000:0.0:1788448354.715010:0:6880:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1788448354.848413:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448355.872361:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448356.581527:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448356.901072:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448357.920780:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448358.949378:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448359.520572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926884352:0@lo:400: 00000100:00100000:3.0:1788448359.520660:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448359.520731:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448359.520738:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926884224:0@lo:400: 00000100:00100000:3.0:1788448359.520779:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448359.520813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884352 00000100:00100000:3.0:1788448359.520821:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884352 00000100:00100000:3.0:1788448359.520879:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884224 00000100:00100000:3.0:1788448359.520883:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884224 00000100:00080000:2.0:1788448359.520892:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448359.520903:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448359.520910:0:5838:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448359.520915:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926884352:12345-0@lo:400: 00000100:00100000:2.0:1788448359.520923:0:5838:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788448359.521036:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448359.521045:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926884224:12345-0@lo:400: 00000100:00100000:2.0:1788448359.521089:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926884224:12345-0@lo:400: Request processed in 45us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448359.521096:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448359.521157:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926884352:12345-0@lo:400: Request processed in 244us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448359.521164:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788448359.521245:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a834876d80 x1875323926884224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448359.521258:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834876d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926884224:0@lo:400: 00010000:00080000:3.0:1788448359.521269:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a834876680 x1875323926884352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448359.521277:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834876680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926884352:0@lo:400: 00000100:00100000:0.0:1788448359.521424:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926884096:0@lo:400: 00000100:00100000:1.0:1788448359.521452:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926884480:0@lo:400: 00000100:00100000:0.0:1788448359.521463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448359.521495:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448359.521580:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884096 00000100:00100000:2.0:1788448359.521585:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884096 00000100:00100000:2.0:1788448359.521621:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788448359.521629:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3310:x1875323926884096:12345-0@lo:400: 00000100:00100000:2.0:1788448359.521677:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3310:x1875323926884096:12345-0@lo:400: Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448359.521684:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788448359.521795:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834876a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926884096:0@lo:400: 00000100:00100000:3.0:1788448359.523465:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884480 00000100:00100000:3.0:1788448359.523478:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884480 00000100:00100000:3.0:1788448359.523562:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448359.523575:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926884480:12345-0@lo:400: 00000100:00100000:3.0:1788448359.523664:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926884480:12345-0@lo:400: Request processed in 93us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448359.523671:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448359.523811:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a834877b80 x1875323926884480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448359.523829:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926884480:0@lo:400: 00000100:00080000:2.0:1788448359.523889:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448359.969301:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448360.033380:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926884608:0@lo:13: 00000100:00100000:0.0:1788448360.033460:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448360.033498:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884608 00000100:00100000:2.0:1788448360.033507:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884608 00000100:00100000:2.0:1788448360.033566:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448360.033576:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926884608:12345-0@lo:13: 00002000:00000024:2.0:1788448360.033608:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448360.033665:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926884608:12345-0@lo:13: Request processed in 90us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448360.033672:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448360.033748:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8079a7100 x1875323926884608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448376 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448360.033769:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926884608:0@lo:13: 00000001:00080000:0.0:1788448360.144887:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1788448360.993400:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448362.018478:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448363.041213:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448364.064530:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448364.647954:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926884736:0@lo:400: 00000100:00100000:1.0:1788448364.647954:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926884992:0@lo:400: 00000100:00100000:3.0:1788448364.648102:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926884864:0@lo:400: 00000100:00100000:1.0:1788448364.648508:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448364.648581:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448364.648589:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926885120:0@lo:400: 00000100:00100000:1.0:1788448364.648618:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448364.648662:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884992 00000100:00100000:1.0:1788448364.648671:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884992 00000100:00100000:1.0:1788448364.648745:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448364.648756:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926884992:12345-0@lo:400: 00000100:00100000:1.0:1788448364.648831:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926884992:12345-0@lo:400: Request processed in 78us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448364.648839:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448364.648869:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885120 00000100:00100000:1.0:1788448364.648873:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885120 00000100:00100000:1.0:1788448364.648902:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448364.648910:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926885120:12345-0@lo:400: 00000100:00100000:1.0:1788448364.648968:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926885120:12345-0@lo:400: Request processed in 51us (340us total) trans 0 rc 0/0 00010000:00080000:0.0:1788448364.648969:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d4700 x1875323926884992/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448364.649007:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926884992:0@lo:400: 00010000:00080000:0.0:1788448364.649055:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d5880 x1875323926885120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448364.649065:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1788448364.649077:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926885120:0@lo:400: 00000100:00080000:0.0:1788448364.649254:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448364.649260:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448364.649291:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448364.649512:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448364.650448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448364.650664:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884864 00000100:00100000:2.0:1788448364.650678:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884864 00000100:00100000:2.0:1788448364.650736:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448364.650747:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926884864:12345-0@lo:400: 00000100:00100000:2.0:1788448364.650844:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926884864:12345-0@lo:400: Request processed in 98us (401us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448364.650852:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788448364.650961:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d6300 x1875323926884864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448380 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448364.650977:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926884864:0@lo:400: 00000100:00100000:0.0:1788448364.652205:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926884736 00000100:00100000:0.0:1788448364.652219:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926884736 00000100:00100000:0.0:1788448364.652280:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788448364.652292:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3311:x1875323926884736:12345-0@lo:400: 00000100:00100000:0.0:1788448364.652381:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3311:x1875323926884736:12345-0@lo:400: Request processed in 90us (3198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448364.652388:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788448364.652890:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926884736:0@lo:400: 00010000:00010000:0.0:1788448365.088259:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448365.162516:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448365.162549:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926885248:0@lo:13: 00000100:00100000:2.0:1788448365.162626:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448365.162693:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885248 00000100:00100000:2.0:1788448365.162820:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885248 00000100:00100000:2.0:1788448365.162992:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448365.163004:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926885248:12345-0@lo:13: 00002000:00000024:2.0:1788448365.163052:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448365.163102:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926885248:12345-0@lo:13: Request processed in 100us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448365.163110:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788448365.163155:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d6300 x1875323926885248/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448381 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448365.163175:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926885248:0@lo:13: 00010000:00010000:0.0:1788448366.112350:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448367.148276:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788448368.068703:0:7621:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788448368.068707:0:7621:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1788448368.068815:0:7621:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a80888c000 00000020:01000004:0.0:1788448368.068832:0:7621:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1788448368.068844:0:7621:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1788448368.068868:0:7621:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99a8075eb370) 00000020:00000080:0.0:1788448368.068884:0:7621:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788448368.081591:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1788448368.081853:0:7621:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788448368.098314:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1788448368.102899:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788448368.102931:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1788448368.103004:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788448368.103029:0:7621:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1788448368.103598:0:7621:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1788448368.103610:0:7621:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788448368.103620:0:7621:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd0e9b344b90aad30 00000020:01000004:0.0:1788448368.103634:0:7621:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1788448368.103655:0:7621:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788448368.103658:0:7621:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788448368.103664:0:7621:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1788448368.103684:0:7621:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1788448368.103689:0:7621:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788448368.123908:0:7621:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788448368.123953:0:7621:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.137@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788448368.123958:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788448368.123960:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788448368.123961:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448368.123963:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448368.123964:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448368.123975:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448368.123976:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448368.123978:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448368.123979:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448368.123981:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448368.123982:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788448368.123985:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788448368.123988:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788448368.123989:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788448368.123990:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448368.123992:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448368.123993:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448368.123994:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448368.123995:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448368.123996:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448368.124003:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448368.124004:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448368.124005:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788448368.124031:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788448368.124053:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926885376:0@lo:253: 00000100:00100000:1.0:1788448368.124353:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.124539:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8028d2600 going to sleep for 11 seconds 00000100:00100000:2.0:1788448368.124741:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885376 00000100:00100000:2.0:1788448368.124749:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885376 00000100:00100000:2.0:1788448368.124802:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788448368.124812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:7621:x1875323926885376:12345-0@lo:253: 20000000:01000000:2.0:1788448368.124840:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1788448368.124853:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:2.0:1788448368.124858:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:2.0:1788448368.124862:0:5829:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1788448368.130031:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448368.130282:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788448368.130297:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1788448368.130335:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788448368.130345:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1788448368.130376:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788448368.130424:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788448368.131378:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788448368.131402:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:2.0:1788448368.131404:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:2.0:1788448368.131438:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788448368.131445:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788448368.132042:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788448368.132053:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:2.0:1788448368.132097:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788448368.132108:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788448368.132137:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788448368.132179:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788448368.133371:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1788448368.133397:0:5829:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.137@tcp 20000000:01000000:2.0:1788448368.133400:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.137@tcp (null) (null) (null) 00000040:00080000:2.0:1788448368.133437:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1788448368.133445:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788448368.133489:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1788448368.133497:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.137@tcp (null) (null) 00000040:00080000:2.0:1788448368.133544:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1788448368.133554:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1788448368.133594:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1788448368.133629:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1788448368.133652:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788448368.133655:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788448368.133658:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788448368.133670:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1788448368.133673:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1788448368.133706:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788448368.133709:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448368.137170:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448368.137294:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448368.137858:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1788448368.138840:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1788448368.138885:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1788448368.138940:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1788448368.138954:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788448368.138957:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788448368.146240:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1788448368.147940:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1788448368.148030:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1788448368.148678:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1788448368.148700:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1788448368.148702:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788448368.154750:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:2.0:1788448368.154854:0:7625:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:2.0:1788448368.154915:0:7625:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1788448368.155780:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1788448368.155829:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1788448368.155899:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1788448368.155917:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1788448368.155920:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788448368.157877:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1788448368.157998:0:7626:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1788448368.158051:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00010000:00010000:0.0:1788448368.162359:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448368.164804:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1788448368.164864:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1788448368.164898:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1788448368.164917:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1788448368.164920:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1788448368.164930:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788448368.164951:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.164982:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.164992:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.164999:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.165006:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.165013:0:5829:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.165038:0:5829:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.166401:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.166426:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.166444:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834876d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885504:0@lo:104: 00000100:00100000:3.0:1788448368.166754:0:5829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448368.166881:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.166891:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 16 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.166900:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885632:0@lo:104: 00010000:00010000:3.0:1788448368.166929:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 16 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.166937:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 16 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.166945:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834876a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885760:0@lo:104: 00010000:00010000:3.0:1788448368.166977:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.166985:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 16 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.167008:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885888:0@lo:104: 00010000:00010000:3.0:1788448368.167032:0:5829:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.167040:0:5829:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 16 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.167048:0:5829:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926886016:0@lo:104: 00000100:00100000:3.0:1788448368.167063:0:5829:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7480 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.170551:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788448368.170607:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.170653:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.170664:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.170675:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.170688:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885504 00000100:00100000:1.0:1788448368.170696:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885504 00000100:00100000:1.0:1788448368.170742:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885632 00000100:00100000:1.0:1788448368.170745:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885632 00000100:00100000:1.0:1788448368.170754:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885760 00000100:00100000:1.0:1788448368.170756:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885760 00000100:00100000:1.0:1788448368.170764:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926885888 00000100:00100000:1.0:1788448368.170767:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926885888 00000100:00100000:1.0:1788448368.170775:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886016 00000100:00100000:1.0:1788448368.170777:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886016 00000100:00100000:1.0:1788448368.170790:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448368.170799:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80876a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:5829:x1875323926885504:12345-0@lo:104: 00010000:00010000:1.0:1788448368.170816:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.170926:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448368.170933:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80876a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:5829:x1875323926885504:12345-0@lo:104: Request processed in 135us (4180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.170940:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448368.170991:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448368.170998:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5829:x1875323926885632:12345-0@lo:104: 00010000:00010000:1.0:1788448368.171006:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.171041:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788448368.171047:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:5829:x1875323926885632:12345-0@lo:104: Request processed in 51us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.171053:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448368.171070:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448368.171076:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:5829:x1875323926885760:12345-0@lo:104: 00010000:00010000:1.0:1788448368.171084:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.171111:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788448368.171115:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:5829:x1875323926885760:12345-0@lo:104: Request processed in 40us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.171121:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448368.171132:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448368.171138:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:5829:x1875323926885888:12345-0@lo:104: 00010000:00010000:1.0:1788448368.171145:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.171179:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788448368.171204:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:5829:x1875323926885888:12345-0@lo:104: Request processed in 47us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.171211:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448368.171223:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448368.171229:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5829:x1875323926886016:12345-0@lo:104: 00010000:00010000:1.0:1788448368.171236:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.171261:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788448368.171265:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5829:x1875323926886016:12345-0@lo:104: Request processed in 37us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.171271:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788448368.171362:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788448368.171371:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171378:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448368.171382:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171391:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448368.171399:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.171406:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448368.171608:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171617:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788448368.171672:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926886144:0@lo:103: 00000100:00100000:1.0:1788448368.171708:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448368.171772:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171780:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a800030e00/0xd0e9b344b90aad1b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad22 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171795:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448368.171799:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171806:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448368.171809:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171816:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448368.171823:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.171828:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448368.171846:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171851:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448368.171863:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171869:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810759200/0xd0e9b344b90aacf1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacf8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171878:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448368.171887:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171893:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448368.171896:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171902:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448368.171908:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.171913:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448368.171924:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171930:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448368.171934:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171941:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842178c00/0xd0e9b344b90aacd5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacdc expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171949:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448368.171952:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171958:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448368.171961:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.171989:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448368.171996:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.172002:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448368.172015:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172020:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448368.172089:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926886272:0@lo:103: 00000100:00100000:0.0:1788448368.172120:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.172141:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448368.172147:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926886400:0@lo:103: 00000100:00100000:0.0:1788448368.172166:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.172208:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886144 00000100:00100000:0.0:1788448368.172214:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886144 00010000:00010000:0.0:1788448368.172237:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 17 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.172258:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886272 00000100:00100000:0.0:1788448368.172260:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886272 00010000:00010000:0.0:1788448368.172269:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 18 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.172278:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886400 00000100:00100000:0.0:1788448368.172280:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886400 00010000:00010000:0.0:1788448368.172288:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 19 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.172299:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448368.172313:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926886144:12345-0@lo:103: 00000100:00100000:3.0:1788448368.172460:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834876d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885504:0@lo:104: 00000100:00100000:3.0:1788448368.172473:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885632:0@lo:104: 00000100:00100000:3.0:1788448368.172481:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834876a00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885760:0@lo:104: 00000100:00100000:3.0:1788448368.172488:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926885888:0@lo:104: 00000100:00100000:3.0:1788448368.172496:0:5829:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5829:1875323926886016:0@lo:104: 00010000:00010000:3.0:1788448368.172522:0:5829:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.172629:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.172636:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.172647:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.172662:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810628c00/0xd0e9b344b90aad22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aad1b expref: 19 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.172676:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448368.172796:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172804:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810758600/0xd0e9b344b90aacab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacb2 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172818:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448368.172822:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172828:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448368.172831:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172838:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448368.172845:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.172859:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448368.172878:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172885:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448368.172892:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172898:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a800030000/0xd0e9b344b90aac81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac88 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.172913:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448368.172915:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448368.172916:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448368.172928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926886528:0@lo:103: 00000100:00100000:2.0:1788448368.172955:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.172988:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448368.172994:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926886656:0@lo:103: 00000100:00100000:2.0:1788448368.173013:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.173114:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3312:x1875323926886144:12345-0@lo:103: Request processed in 801us (1404us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.173122:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448368.173139:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886528 00000100:00100000:0.0:1788448368.173142:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886528 00010000:00010000:0.0:1788448368.173155:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 18 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.173167:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886656 00000100:00100000:0.0:1788448368.173169:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886656 00010000:00010000:0.0:1788448368.173177:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.173215:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448368.173223:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926886272:12345-0@lo:103: 00010000:00010000:0.0:1788448368.173231:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.173235:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173255:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173265:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629400/0xd0e9b344b90aacf8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aacf1 expref: 19 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173275:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448368.173305:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3309:x1875323926886272:12345-0@lo:103: Request processed in 83us (1185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.173311:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448368.173524:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926886272:0@lo:103: 00000100:00100000:0.0:1788448368.173557:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448368.173566:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3309:x1875323926886400:12345-0@lo:103: 00010000:00010000:0.0:1788448368.173574:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.173578:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 17 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173589:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 17 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173599:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810759000/0xd0e9b344b90aacdc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aacd5 expref: 17 pid: 5830 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173609:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448368.173641:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3309:x1875323926886400:12345-0@lo:103: Request processed in 78us (1474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.173647:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448368.173660:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448368.173666:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3311:x1875323926886528:12345-0@lo:103: 00010000:00010000:0.0:1788448368.173683:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.173688:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173697:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173706:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800030c00/0xd0e9b344b90aacb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aacab expref: 15 pid: 5831 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173716:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448368.173801:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926886400:0@lo:103: 00000100:00100000:0.0:1788448368.173838:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3311:x1875323926886528:12345-0@lo:103: Request processed in 173us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.173845:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448368.173857:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448368.173864:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3311:x1875323926886656:12345-0@lo:103: 00010000:00010000:0.0:1788448368.173871:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.173875:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 13 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173885:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 13 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173895:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629800/0xd0e9b344b90aac88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aac81 expref: 13 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173905:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173914:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173932:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173939:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173946:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173952:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173957:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247a00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448368.173961:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.173979:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.174000:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.174011:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448368.174033:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3311:x1875323926886656:12345-0@lo:103: Request processed in 170us (1019us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.174039:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:0.0:1788448368.174063:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448368.174102:0:5829:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.174110:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.174129:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247a00/0xd0e9b344b90aad37 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788448368.174143:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788448368.174234:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926886144:0@lo:103: 00000100:00100000:3.0:1788448368.179224:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926886528:0@lo:103: 00000100:00100000:3.0:1788448368.180254:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926886656:0@lo:103: 00000100:00100000:3.0:1788448368.220406:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:7621:x1875323926885376:12345-0@lo:253: Request processed in 95585us (96044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.220422:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448368.220616:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926885376:0@lo:253: 10000000:01000000:1.0:1788448368.220632:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788448368.220635:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448368.220637:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788448368.220638:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448368.220640:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1788448368.220641:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448368.220642:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448368.220644:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448368.220646:0:7621:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1788448368.220647:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448368.220662:0:7621:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788448368.220681:0:7621:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a80888c000 from lustre-OST0001 10000000:01000000:1.0:1788448368.220707:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788448368.220710:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788448368.220718:0:7621:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a8065799b8 local copy 10000000:01000000:1.0:1788448368.220722:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788448368.220760:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.220772:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.220781:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448368.220799:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926886784:0@lo:101: 00000100:00100000:1.0:1788448368.220839:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.220876:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.220934:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886784 00000100:00100000:3.0:1788448368.220940:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886784 00000100:00100000:3.0:1788448368.220996:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448368.221005:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+11:7621:x1875323926886784:12345-0@lo:101: 00010000:00010000:3.0:1788448368.221016:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448368.221029:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246e00/0xd0e9b344b90aad45 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aad3e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.221053:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246e00/0xd0e9b344b90aad45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aad3e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.221064:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246e00/0xd0e9b344b90aad45 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad3e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.221074:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246e00, rc 0) 00000100:00100000:3.0:1788448368.221119:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:7621:x1875323926886784:12345-0@lo:101: Request processed in 115us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.221125:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448368.221158:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926886784:0@lo:101: 00010000:00010000:3.0:1788448368.221171:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.221180:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.221301:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926886912:0@lo:501: 00000100:00100000:3.0:1788448368.221648:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448368.221675:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a803d90480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.221693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926886912 00000100:00100000:3.0:1788448368.221696:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926886912 00000100:00100000:3.0:1788448368.221735:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788448368.221747:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:7621:x1875323926886912:12345-0@lo:501: 00000100:00100000:3.0:1788448368.221955:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:7621:x1875323926886912:12345-0@lo:501: Request processed in 208us (307us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448368.221962:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788448368.222002:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926886912:0@lo:501: 10000000:01000000:3.0:1788448368.222017:0:7621:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788448368.222047:0:7621:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788448368.222054:0:7621:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222063:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222070:0:7621:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222411:0:7621:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788448368.222436:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a80888c000 10000000:01000000:3.0:1788448368.222441:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788448368.222517:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788448368.222520:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448368.222525:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788448368.222528:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788448368.222555:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222563:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222587:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.222603:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887040:0@lo:101: 00000100:00100000:3.0:1788448368.222634:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448368.222659:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a803d90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.222684:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887040 00000100:00100000:3.0:1788448368.222688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887040 00000100:00100000:3.0:1788448368.222712:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788448368.222720:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:7621:x1875323926887040:12345-0@lo:101: 00010000:00010000:3.0:1788448368.222730:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448368.222740:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aad4c expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222759:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222768:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222776:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246400, rc 0) 00000100:00100000:3.0:1788448368.222808:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887040:12345-0@lo:101: Request processed in 89us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.222814:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788448368.222848:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887040:0@lo:101: 00010000:00010000:3.0:1788448368.222860:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.222879:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.222945:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887168:0@lo:501: 00000100:00100000:3.0:1788448368.222983:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448368.222997:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a803d90c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.223010:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887168 00000100:00100000:3.0:1788448368.223014:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887168 00000100:00100000:3.0:1788448368.223032:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448368.223039:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887168:12345-0@lo:501: 00000100:00100000:3.0:1788448368.223263:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887168:12345-0@lo:501: Request processed in 223us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.223270:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448368.223302:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887168:0@lo:501: 00000100:00100000:3.0:1788448368.223581:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887296:0@lo:503: 00000100:00100000:3.0:1788448368.223621:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448368.223684:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a803d90c00 going to sleep for 11 seconds 00010000:00010000:1.0:1788448368.223810:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448368.223817:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.223826:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448368.223830:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.223838:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448368.223844:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448368.223861:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1788448368.223912:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887296 00000100:00100000:2.0:1788448368.223917:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887296 00000100:00100000:2.0:1788448368.223952:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788448368.223960:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887296:12345-0@lo:503: 00000100:00100000:2.0:1788448368.224154:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887296:12345-0@lo:503: Request processed in 194us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.224161:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448368.224272:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887296:0@lo:503: 00000040:00080000:0.0:1788448368.224682:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448368.224753:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887424:0@lo:502: 00000100:00100000:0.0:1788448368.224794:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.224822:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.225025:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887424 00000100:00100000:3.0:1788448368.225031:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887424 00000100:00100000:3.0:1788448368.225055:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448368.225063:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887424:12345-0@lo:502: 00000100:00100000:3.0:1788448368.225263:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887424:12345-0@lo:502: Request processed in 200us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.225270:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788448368.225672:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887424:0@lo:502: 00000040:00080000:0.0:1788448368.225943:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1788448368.226007:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1788448368.226039:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1788448368.226100:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1788448368.226558:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1788448368.226596:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1788448368.226635:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887552:0@lo:502: 00000100:00100000:0.0:1788448368.226697:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.226727:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.227818:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887552 00000100:00100000:3.0:1788448368.227839:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887552 00000100:00100000:3.0:1788448368.227879:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448368.227888:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887552:12345-0@lo:502: 00000100:00100000:3.0:1788448368.228959:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887552:12345-0@lo:502: Request processed in 1065us (2255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.228980:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448368.229552:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887552:0@lo:502: 00000040:00080000:2.0:1788448368.229721:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1788448368.229735:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:2.0:1788448368.230277:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.230289:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788448368.230403:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926887680:0@lo:103: 00000100:00100000:3.0:1788448368.230657:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448368.230791:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.230800:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90aad3e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xd0e9b344b90aad45 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.230816:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448368.230819:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448368.230821:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788448368.230908:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448368.230923:0:7628:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1788448368.230929:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448368.230931:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788448368.230936:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448368.230951:0:7628:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99a806498000) 00000020:00000080:2.0:1788448368.230983:0:7628:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788448368.230991:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448368.231053:0:7628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a80888c000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788448368.231062:0:7628:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448368.231067:0:7628:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd0e9b344b90aad61 00000100:00100000:0.0:1788448368.234251:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887680 00000100:00100000:0.0:1788448368.234272:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887680 00000100:00100000:0.0:1788448368.234369:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448368.234381:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3309:x1875323926887680:12345-0@lo:103: 00010000:00010000:0.0:1788448368.234397:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.234418:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246e00/0xd0e9b344b90aad45 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aad3e expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.234438:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448368.236793:0:7628:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1788448368.237531:0:7628:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000100:00100000:3.0:1788448368.239258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926887680:0@lo:103: 00000100:00100000:0.0:1788448368.239258:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:3309:x1875323926887680:12345-0@lo:103: Request processed in 4872us (8592us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.239272:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00000004:2.0:1788448368.240536:0:7628:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1788448368.240857:0:7628:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1788448368.244011:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1788448368.245454:0:7628:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1788448368.246892:0:7628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788448368.246905:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448368.246912:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448368.246915:0:7628:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788448368.246918:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448368.246923:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448368.246924:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448368.246927:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448368.246929:0:7628:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448368.246990:0:7628:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448368.246993:0:7628:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448368.246995:0:7628:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788448368.246998:0:7628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788448368.247164:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1788448368.247216:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788448368.247235:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.247247:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448368.247254:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80888c000 from 1 10000000:01000000:1.0:1788448368.247258:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448368.247294:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.247302:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.247314:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448368.247338:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887808:0@lo:101: 00000100:00100000:1.0:1788448368.247407:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.247443:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809accd80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448368.249949:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887808 00000100:00100000:2.0:1788448368.249961:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887808 00000100:00100000:2.0:1788448368.250024:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448368.250035:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:7621:x1875323926887808:12345-0@lo:101: 00010000:00010000:2.0:1788448368.250060:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448368.250092:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aad68 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.250122:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.250134:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.250144:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178e00, rc 0) 00000100:00100000:2.0:1788448368.250256:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887808:12345-0@lo:101: Request processed in 222us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.250263:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788448368.252286:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887808:0@lo:101: 00010000:00010000:1.0:1788448368.252315:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448368.252328:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448368.252467:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887936:0@lo:501: 00000100:00100000:1.0:1788448368.252522:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.252558:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809accd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.252579:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926887936 00000100:00100000:1.0:1788448368.252586:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926887936 00000100:00100000:1.0:1788448368.252631:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788448368.252640:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887936:12345-0@lo:501: 00000100:00100000:1.0:1788448368.252896:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926887936:12345-0@lo:501: Request processed in 256us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.252904:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788448368.252939:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926887936:0@lo:501: 00000100:00100000:1.0:1788448368.252978:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888064:0@lo:503: 00000100:00100000:1.0:1788448368.253018:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.253034:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809accd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.253055:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888064 00000100:00100000:1.0:1788448368.253059:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888064 00000100:00100000:1.0:1788448368.253075:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448368.253079:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888064:12345-0@lo:503: 00000100:00100000:1.0:1788448368.253398:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888064:12345-0@lo:503: Request processed in 316us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.253404:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448368.253434:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888064:0@lo:503: 00000040:00080000:1.0:1788448368.253689:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448368.253755:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888192:0@lo:502: 00000100:00100000:1.0:1788448368.253794:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.253805:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809accd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.253827:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888192 00000100:00100000:1.0:1788448368.253832:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888192 00000100:00100000:1.0:1788448368.253852:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788448368.253858:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888192:12345-0@lo:502: 00000100:00100000:1.0:1788448368.254015:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888192:12345-0@lo:502: Request processed in 157us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.254022:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788448368.254050:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888192:0@lo:502: 00000040:00080000:1.0:1788448368.254317:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1788448368.254364:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1788448368.254386:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888320:0@lo:502: 00000100:00100000:1.0:1788448368.254419:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.254428:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809accd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.254447:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888320 00000100:00100000:1.0:1788448368.254452:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888320 00000100:00100000:1.0:1788448368.254469:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788448368.254475:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888320:12345-0@lo:502: 00000100:00100000:1.0:1788448368.254587:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888320:12345-0@lo:502: Request processed in 111us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448368.254594:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788448368.254621:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888320:0@lo:502: 00000040:00080000:1.0:1788448368.254684:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1788448368.254693:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788448368.257781:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448368.257794:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448368.257808:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788448368.257816:0:7632:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a80888c000 00000020:00000080:1.0:1788448368.257818:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448368.257843:0:7632:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448368.257847:0:7632:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448368.257848:0:7632:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788448368.257851:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788448368.257998:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788448368.258024:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448368.258146:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.258161:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448368.258243:0:7621:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788448368.258246:0:7621:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a80888c000 10000000:01000000:2.0:1788448368.258250:0:7621:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a80888c000 10000000:01000000:2.0:1788448368.258255:0:7621:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448368.258261:0:7621:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80888c000 from 1 10000000:01000000:2.0:1788448368.258265:0:7621:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448368.258304:0:7621:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.258324:0:7621:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.258336:0:7621:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448368.258361:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888448:0@lo:101: 00000100:00100000:2.0:1788448368.258430:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.258470:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.258587:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888448 00000100:00100000:3.0:1788448368.258597:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888448 00000100:00100000:3.0:1788448368.258681:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788448368.258692:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926888448:12345-0@lo:101: 00010000:00010000:3.0:1788448368.258708:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448368.258723:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aad76 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.258747:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.258759:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448368.258771:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246a00, rc 0) 00000100:00100000:3.0:1788448368.258814:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888448:12345-0@lo:101: Request processed in 125us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.258821:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788448368.259162:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888448:0@lo:101: 00010000:00010000:2.0:1788448368.259178:0:7621:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.259364:0:7621:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448368.259461:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888576:0@lo:501: 00000100:00100000:2.0:1788448368.259494:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.259566:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.259640:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888576 00000100:00100000:3.0:1788448368.259655:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888576 00000100:00100000:3.0:1788448368.259690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788448368.259698:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888576:12345-0@lo:501: 00000100:00100000:3.0:1788448368.260012:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888576:12345-0@lo:501: Request processed in 313us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.260019:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788448368.260171:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888576:0@lo:501: 00000100:00100000:1.0:1788448368.260380:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888704:0@lo:503: 00000100:00100000:1.0:1788448368.260423:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.260452:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448368.260490:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888704 00000100:00100000:2.0:1788448368.260496:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888704 00000100:00100000:2.0:1788448368.260527:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448368.260534:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888704:12345-0@lo:503: 00000100:00100000:2.0:1788448368.260684:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888704:12345-0@lo:503: Request processed in 150us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.260691:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788448368.260765:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888704:0@lo:503: 00000040:00080000:1.0:1788448368.261048:0:7621:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448368.261112:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888832:0@lo:502: 00000100:00100000:1.0:1788448368.261145:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.261161:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.261431:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888832 00000100:00100000:3.0:1788448368.261436:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888832 00000100:00100000:3.0:1788448368.261474:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788448368.261482:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888832:12345-0@lo:502: 00000100:00100000:3.0:1788448368.261674:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888832:12345-0@lo:502: Request processed in 191us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.261681:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788448368.261756:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888832:0@lo:502: 00000040:00080000:1.0:1788448368.262019:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788448368.262072:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788448368.262217:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788448368.262274:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1788448368.262311:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1788448368.262356:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1788448368.262392:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1788448368.262421:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1788448368.262464:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1788448368.262498:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1788448368.262532:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1788448368.262590:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1788448368.262635:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1788448368.262670:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1788448368.262718:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1788448368.262754:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1788448368.262786:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1788448368.262832:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1788448368.262868:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1788448368.262902:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1788448368.262950:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1788448368.263001:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1788448368.263036:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1788448368.263278:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1788448368.263317:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1788448368.263347:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1788448368.263388:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1788448368.263424:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1788448368.263454:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1788448368.263493:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1788448368.263524:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1788448368.263556:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1788448368.263582:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1788448368.263630:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1788448368.263667:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1788448368.263713:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1788448368.263750:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1788448368.263796:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888960:0@lo:502: 00000100:00100000:1.0:1788448368.263870:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.263961:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448368.264141:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926888960 00000100:00100000:3.0:1788448368.264150:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926888960 00000100:00100000:3.0:1788448368.264236:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788448368.264248:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888960:12345-0@lo:502: 00000100:00100000:3.0:1788448368.264506:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926888960:12345-0@lo:502: Request processed in 259us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.264514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788448368.264799:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926888960:0@lo:502: 00000040:00080000:1.0:1788448368.264875:0:7621:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1788448368.264885:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1788448368.265732:0:7633:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788448368.265751:0:7633:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99a80649b370) 00000020:00000080:2.0:1788448368.265777:0:7633:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1788448368.265860:0:7633:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a80888c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788448368.265864:0:7633:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a80888c000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788448368.265867:0:7633:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80888c000 3 00010000:00080000:2.0:1788448368.265905:0:7633:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a834867800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.137@tcp at head 00010000:00010000:2.0:1788448368.268071:0:7633:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1788448368.268590:0:7633:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788448368.268628:0:7633:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788448368.268642:0:7633:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd0e9b344b90aad8b 00000100:00080000:2.0:1788448368.268653:0:7633:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788448368.268658:0:7633:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a834867800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1788448368.268693:0:7633:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a8359d6680 x1875323926889088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788448368.268719:0:7633:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788448368.268911:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926889088:0@lo:38: 00000100:00100000:0.0:1788448368.269002:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.269218:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889088 00000100:00100000:2.0:1788448368.269226:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889088 00000100:00100000:2.0:1788448368.269259:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448368.269267:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875323926889088:12345-0@lo:38: 00010000:00080000:2.0:1788448368.269290:0:5839:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 228 last 0 00000020:00000080:2.0:1788448368.269345:0:5839:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd0e9b344b90aad92 00000004:00100000:2.0:1788448368.269361:0:5839:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448368.269391:0:5839:0:(import.c:65:import_set_state_nolock()) ffff99a83fccb000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448368.269448:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875323926889088:12345-0@lo:38: Request processed in 179us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.269455:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788448368.269496:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d6680 x1875323926889088/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448368.269511:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448368.269519:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:2.0:1788448368.269525:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448368.269530:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448368.269532:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a834867800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448368.269537:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926889088:0@lo:38: 00000040:00080000:2.0:1788448368.269670:0:7633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00100000:2.0:1788448368.269800:0:7634:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1875323926889216:0@lo:901: 00000100:00100000:2.0:1788448368.269830:0:7634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.269859:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889216 00000100:00100000:2.0:1788448368.269863:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889216 00000100:00100000:2.0:1788448368.269899:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448368.269906:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1875323926889216:12345-0@lo:901: 00000100:00100000:2.0:1788448368.270360:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7634:x1875323926889216:12345-0@lo:901: Request processed in 454us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.270367:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788448368.270385:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448368.270396:0:7634:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2a80 going to sleep for 11 seconds 00010000:00080000:2.0:1788448368.270410:0:7634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a8359d6680 x1875323926889216/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788448384 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448368.270420:0:7634:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7634:1875323926889216:0@lo:901: 00000020:01000000:0.0:1788448368.273224:0:7621:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:0.0:1788448368.273271:0:7621:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448368.273298:0:7621:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.273311:0:7621:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788448368.273378:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788448368.273380:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448368.273382:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448368.273383:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448368.273384:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448368.273385:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448368.273387:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448368.273389:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448368.273391:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448368.273392:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448368.273394:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448368.273398:0:7621:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788448368.273402:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448368.273403:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448368.273404:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448368.273405:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448368.273406:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448368.273408:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448368.273409:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448368.273410:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788448368.273411:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788448368.273411:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448368.273412:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448368.273443:0:7621:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788448368.273465:0:7621:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926889344:0@lo:253: 00000100:00100000:0.0:1788448368.273535:0:7621:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.273572:0:7621:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448368.273740:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448368.273754:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926889600:0@lo:400: 00000100:00100000:1.0:1788448368.273787:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448368.273848:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926889728:0@lo:400: 00000100:00100000:1.0:1788448368.273873:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.273948:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926889472:0@lo:400: 00000100:00100000:0.0:1788448368.273988:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.274030:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889728 00000100:00100000:0.0:1788448368.274037:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889728 00000100:00100000:0.0:1788448368.274105:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448368.274115:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926889728:12345-0@lo:400: 00000100:00100000:0.0:1788448368.274163:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926889728:12345-0@lo:400: Request processed in 50us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.274169:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788448368.274231:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a7056c4380 x1875323926889728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448368.274246:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926889728:0@lo:400: 00000100:00100000:3.0:1788448368.274473:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889344 00000100:00100000:3.0:1788448368.274478:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889344 00000100:00100000:3.0:1788448368.274506:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788448368.274514:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:7621:x1875323926889344:12345-0@lo:253: 20000000:01000000:3.0:1788448368.274534:0:5831:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1788448368.274547:0:5831:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1788448368.275386:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889600 00000100:00100000:2.0:1788448368.275395:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889600 00000100:00100000:2.0:1788448368.275447:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889472 00000100:00100000:2.0:1788448368.275451:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889472 00000100:00100000:2.0:1788448368.275476:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448368.275490:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926889600:12345-0@lo:400: 00000100:00100000:2.0:1788448368.275550:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926889600:12345-0@lo:400: Request processed in 62us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.275557:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448368.275572:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448368.275577:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926889472:12345-0@lo:400: 00000100:00100000:2.0:1788448368.275607:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926889472:12345-0@lo:400: Request processed in 30us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448368.275613:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788448368.275635:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448368.275639:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448368.275667:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807976300 x1875323926889600/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448368.275680:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926889600:0@lo:400: 00010000:00080000:2.0:1788448368.275710:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a807975f80 x1875323926889472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448368.275719:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926889472:0@lo:400: 20000000:01000000:0.0:1788448368.311100:0:5831:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448368.311124:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788448368.311251:0:5853:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448368.311255:0:5853:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448368.311277:0:5853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.311295:0:5853:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.311303:0:5853:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.311640:0:5853:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448368.311657:0:5853:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448368.311672:0:5853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926889856:0@lo:104: 00000100:00100000:2.0:1788448368.311735:0:5853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448368.311794:0:5853:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448368.312165:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889856 00000100:00100000:0.0:1788448368.312174:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889856 00000100:00100000:0.0:1788448368.312242:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448368.312253:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926889856:12345-0@lo:104: 00010000:00010000:0.0:1788448368.312266:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312390:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448368.312397:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:5853:x1875323926889856:12345-0@lo:104: Request processed in 146us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.312405:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:0.0:1788448368.312431:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448368.312437:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312508:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448368.312521:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312530:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448368.312537:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448368.312544:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448368.312574:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312581:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448368.312600:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312607:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90aace3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aacea expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312630:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448368.312632:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448368.312634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448368.312646:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926889984:0@lo:103: 00000100:00100000:0.0:1788448368.312681:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448368.312716:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926889984 00000100:00100000:0.0:1788448368.312720:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926889984 00010000:00010000:0.0:1788448368.312738:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 15 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.312761:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448368.312775:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804616450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3309:x1875323926889984:12345-0@lo:103: 00010000:00010000:0.0:1788448368.312785:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448368.312791:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 15 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312801:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 15 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312817:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312825:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788448368.312838:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001583097s 00010000:00010000:0.0:1788448368.312842:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312849:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312856:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312863:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312868:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448368.312873:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312880:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312896:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.312905:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448368.312935:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804616450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3309:x1875323926889984:12345-0@lo:103: Request processed in 161us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448368.312941:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788448368.313016:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926889984:0@lo:103: 00010000:00010000:0.0:1788448368.313043:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810758c00/0xd0e9b344b90aacea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aace3 expref: 14 pid: 5829 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448368.313053:0:5853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5853:1875323926889856:0@lo:104: 00010000:00010000:0.0:1788448368.313065:0:5853:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.313074:0:5853:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.313400:0:5853:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448368.313407:0:5853:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aad99 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5853 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448368.320218:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:7621:x1875323926889344:12345-0@lo:253: Request processed in 45695us (46672us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448368.320249:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788448368.320465:0:7621:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:623f2df2-d49f-4f54-8e7f-befebe2e7643:7621:1875323926889344:0@lo:253: 10000000:01000000:1.0:1788448368.320484:0:7621:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788448368.320488:0:7621:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788448368.320489:0:7621:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788448368.320491:0:7621:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448368.320492:0:7621:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448368.320494:0:7621:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448368.320495:0:7621:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448368.320496:0:7621:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448368.320498:0:7621:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788448368.320499:0:7621:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788448368.320501:0:7621:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448368.320502:0:7621:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788448368.320518:0:7621:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1788448368.326707:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448368.326918:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1788448368.327387:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448368.327957:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1788448368.328574:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1788448368.328828:0:7621:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788448368.330063:0:7621:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:3.0:1788448368.530826:0:7621:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788448368.530833:0:7621:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788448368.530865:0:7621:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788448368.530923:0:7621:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788448368.530937:0:7621:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788448368.530974:0:7621:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1788448369.184924:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448370.209299:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448370.273379:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926890112:0@lo:13: 00000100:00100000:3.0:1788448370.273462:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448370.273675:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890112 00000100:00100000:2.0:1788448370.273684:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890112 00000100:00080000:3.0:1788448370.273792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448370.273826:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448370.273837:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926890112:12345-0@lo:13: 00002000:00000024:2.0:1788448370.273876:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448370.273942:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926890112:12345-0@lo:13: Request processed in 108us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448370.273949:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788448370.274008:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d7480 x1875323926890112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448386 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448370.274028:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926890112:0@lo:13: 00010000:00010000:2.0:1788448371.233181:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448372.264960:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448373.286310:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448373.348797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926890368:0@lo:400: 00000100:00100000:2.0:1788448373.348888:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448373.348953:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926890240:0@lo:400: 00000100:00100000:2.0:1788448373.348972:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926890496:0@lo:400: 00000100:00100000:2.0:1788448373.349977:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448373.350024:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448373.350035:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926890624:0@lo:400: 00000100:00100000:2.0:1788448373.350065:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448373.350123:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890368 00000100:00100000:2.0:1788448373.350134:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890368 00000100:00100000:2.0:1788448373.350228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890496 00000100:00100000:2.0:1788448373.350232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890496 00000100:00100000:2.0:1788448373.350438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448373.350447:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926890368:12345-0@lo:400: 00000100:00100000:2.0:1788448373.350626:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926890368:12345-0@lo:400: Request processed in 60us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448373.350636:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448373.350654:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448373.350661:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926890496:12345-0@lo:400: 00000100:00100000:2.0:1788448373.350696:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926890496:12345-0@lo:400: Request processed in 37us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448373.350702:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448373.350724:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890624 00000100:00100000:2.0:1788448373.350727:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890624 00000100:00100000:2.0:1788448373.350756:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448373.350762:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926890624:12345-0@lo:400: 00000100:00100000:2.0:1788448373.350791:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926890624:12345-0@lo:400: Request processed in 29us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448373.350818:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1788448373.350839:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448373.350844:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788448373.350916:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4000 x1875323926890368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448373.350930:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926890368:0@lo:400: 00010000:00080000:2.0:1788448373.350957:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d7100 x1875323926890624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448373.350965:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926890624:0@lo:400: 00010000:00080000:2.0:1788448373.350975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d7800 x1875323926890496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448373.350982:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926890496:0@lo:400: 00000100:00100000:0.0:1788448373.352713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448373.352800:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926890752:0@lo:400: 00000100:00100000:0.0:1788448373.352860:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448373.352913:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890240 00000100:00100000:0.0:1788448373.352923:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890240 00000100:00100000:0.0:1788448373.352968:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788448373.352977:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3311:x1875323926890240:12345-0@lo:400: 00000100:00100000:0.0:1788448373.353024:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:3311:x1875323926890240:12345-0@lo:400: Request processed in 48us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448373.353031:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788448373.353078:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926890240:0@lo:400: 00000100:00100000:2.0:1788448373.354307:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890752 00000100:00100000:2.0:1788448373.354318:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890752 00000100:00100000:2.0:1788448373.354364:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448373.354372:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926890752:12345-0@lo:400: 00000100:00100000:2.0:1788448373.354429:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926890752:12345-0@lo:400: Request processed in 58us (1567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448373.354436:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788448373.354533:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d5180 x1875323926890752/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448373.354623:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926890752:0@lo:400: 00000100:00080000:0.0:1788448373.356629:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448374.305392:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448374.476345:0:7975:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448375.329970:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448375.393346:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926890880:0@lo:13: 00000100:00100000:2.0:1788448375.393427:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448375.393595:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926890880 00000100:00100000:3.0:1788448375.393616:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926890880 00000100:00080000:0.0:1788448375.393672:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448375.393679:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448375.393702:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926890880:12345-0@lo:13: 00002000:00000024:3.0:1788448375.393739:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788448375.393839:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d5180 x1875323926890880/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448391 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448375.393859:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926890880:0@lo:13: 00000100:00100000:3.0:1788448375.393995:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926890880:12345-0@lo:13: Request processed in 104us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448375.394004:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1788448376.352440:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448377.387781:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448377.453298:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788448377.453309:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a8092e0800 from 30 10000000:01000000:1.0:1788448377.453315:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788448377.453423:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.453436:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.453449:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448377.453487:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891008:0@lo:101: 00000100:00100000:1.0:1788448377.453561:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.453658:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a573c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448377.457822:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891008 00000100:00100000:2.0:1788448377.457840:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891008 00000100:00100000:2.0:1788448377.457905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448377.457915:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926891008:12345-0@lo:101: 00010000:00010000:2.0:1788448377.457934:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448377.457957:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aada0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.458010:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.458023:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.458032:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178c00, rc 0) 00000100:00100000:2.0:1788448377.458121:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891008:12345-0@lo:101: Request processed in 208us (4560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.458128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448377.458217:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891008:0@lo:101: 00010000:00010000:2.0:1788448377.458237:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.458246:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448377.458342:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891136:0@lo:501: 00000100:00100000:2.0:1788448377.458376:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.458406:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891136 00000100:00100000:0.0:1788448377.458412:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891136 00000100:00100000:2.0:1788448377.458419:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83504d540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.458452:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788448377.458462:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891136:12345-0@lo:501: 00000100:00100000:0.0:1788448377.458835:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891136:12345-0@lo:501: Request processed in 374us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.458843:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788448377.462893:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891136:0@lo:501: 00000100:00100000:2.0:1788448377.462958:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891264:0@lo:503: 00000100:00100000:2.0:1788448377.463033:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.463085:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83504d540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.463136:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891264 00000100:00100000:3.0:1788448377.463143:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891264 00000100:00100000:3.0:1788448377.463216:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788448377.463228:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891264:12345-0@lo:503: 00000100:00100000:3.0:1788448377.463603:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891264:12345-0@lo:503: Request processed in 376us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.463618:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788448377.463780:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891264:0@lo:503: 00000100:00100000:2.0:1788448377.464462:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8090:1875323926891392:0@lo:502: 00000100:00100000:2.0:1788448377.464516:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.464554:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83504db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.464661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891392 00000100:00100000:3.0:1788448377.464668:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891392 00000100:00100000:3.0:1788448377.464710:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448377.464719:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8090:x1875323926891392:12345-0@lo:502: 00000100:00100000:3.0:1788448377.465003:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8090:x1875323926891392:12345-0@lo:502: Request processed in 284us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.465010:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788448377.465090:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8090:1875323926891392:0@lo:502: 00000100:00100000:2.0:1788448377.465142:0:8090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8090:1875323926891520:0@lo:502: 00000100:00100000:2.0:1788448377.465177:0:8090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.465231:0:8090:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808805540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.466311:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891520 00000100:00100000:3.0:1788448377.466321:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891520 00000100:00100000:3.0:1788448377.466409:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788448377.466420:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8090:x1875323926891520:12345-0@lo:502: 00000100:00100000:3.0:1788448377.466668:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8090:x1875323926891520:12345-0@lo:502: Request processed in 249us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.466676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788448377.467910:0:8090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8090:1875323926891520:0@lo:502: 00000040:00080000:1.0:1788448377.467962:0:8090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1788448377.468183:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1788448377.468222:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448377.468233:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.468245:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448377.468266:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788448377.468269:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1788448377.468271:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788448377.468303:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.468311:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.468320:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448377.468340:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891648:0@lo:101: 00000100:00100000:0.0:1788448377.468392:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.469045:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cbe40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448377.469143:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891648 00000100:00100000:2.0:1788448377.469151:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891648 00000100:00100000:2.0:1788448377.469206:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448377.469215:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926891648:12345-0@lo:101: 00010000:00010000:2.0:1788448377.469232:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448377.469246:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aadae expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.469269:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.469285:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.469294:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179e00, rc 0) 00000100:00100000:2.0:1788448377.469473:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926891648:12345-0@lo:101: Request processed in 258us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.469480:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788448377.469522:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891648:0@lo:101: 00010000:00010000:2.0:1788448377.469535:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448377.469544:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448377.469592:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891776:0@lo:501: 00000100:00100000:2.0:1788448377.469615:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.469630:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891776 00000100:00100000:2.0:1788448377.469634:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891776 00000100:00100000:2.0:1788448377.469648:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448377.469654:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926891776:12345-0@lo:501: 00000100:00100000:2.0:1788448377.469993:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926891776:12345-0@lo:501: Request processed in 338us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.470000:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448377.470024:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808805540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448377.470033:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891776:0@lo:501: 00000100:00100000:2.0:1788448377.470055:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891904:0@lo:503: 00000100:00100000:2.0:1788448377.470092:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.470145:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808805540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.470209:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926891904 00000100:00100000:0.0:1788448377.470214:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926891904 00000100:00100000:3.0:1788448377.470440:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788448377.470535:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926891904:12345-0@lo:503: 00000100:00100000:0.0:1788448377.470860:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926891904:12345-0@lo:503: Request processed in 412us (766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.470867:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788448377.471289:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926891904:0@lo:503: 00000100:00100000:2.0:1788448377.471646:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8092:1875323926892032:0@lo:502: 00000100:00100000:2.0:1788448377.471684:0:8092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.471712:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808805540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.471747:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892032 00000100:00100000:0.0:1788448377.471752:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892032 00000100:00100000:0.0:1788448377.471799:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448377.471807:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8092:x1875323926892032:12345-0@lo:502: 00000100:00100000:0.0:1788448377.471995:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8092:x1875323926892032:12345-0@lo:502: Request processed in 188us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.472011:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788448377.472087:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8092:1875323926892032:0@lo:502: 00000020:01000000:2.0:1788448377.472114:0:8092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448377.472124:0:8092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448377.472126:0:8092:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448377.472131:0:8092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448377.472133:0:8092:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788448377.472149:0:8092:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8092:1875323926892160:0@lo:502: 00000100:00100000:2.0:1788448377.472178:0:8092:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.472236:0:8092:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcf180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.472501:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892160 00000100:00100000:0.0:1788448377.472505:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892160 00000100:00100000:0.0:1788448377.472555:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448377.472562:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8092:x1875323926892160:12345-0@lo:502: 00000100:00100000:0.0:1788448377.472683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8092:x1875323926892160:12345-0@lo:502: Request processed in 121us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.472689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788448377.472735:0:8092:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8092:1875323926892160:0@lo:502: 00000020:01000000:2.0:1788448377.473918:0:8092:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448377.473929:0:8092:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448377.473931:0:8092:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788448377.473936:0:8092:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1788448377.474508:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788448377.474528:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788448377.474539:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.474552:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448377.474563:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788448377.474566:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80badd000 from 30 10000000:01000000:0.0:1788448377.474569:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448377.474606:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.474614:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.474624:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448377.474647:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892288:0@lo:101: 00000100:00100000:0.0:1788448377.474719:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.474762:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.474821:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892288 00000100:00100000:3.0:1788448377.474829:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892288 00000100:00100000:3.0:1788448377.474882:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788448377.474893:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926892288:12345-0@lo:101: 00010000:00010000:3.0:1788448377.474907:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448377.474922:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aadbc expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448377.474947:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448377.474959:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448377.474975:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247c00, rc 0) 00000100:00100000:3.0:1788448377.475013:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892288:12345-0@lo:101: Request processed in 122us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.475020:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448377.475099:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892288:0@lo:101: 00010000:00010000:0.0:1788448377.475113:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.475122:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448377.475170:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892416:0@lo:501: 00000100:00100000:0.0:1788448377.475228:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.475247:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.475312:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892416 00000100:00100000:3.0:1788448377.475317:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892416 00000100:00100000:3.0:1788448377.475451:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788448377.475459:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892416:12345-0@lo:501: 00000100:00100000:3.0:1788448377.475704:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892416:12345-0@lo:501: Request processed in 246us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.475711:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788448377.475839:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892416:0@lo:501: 00000100:00100000:0.0:1788448377.475869:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892544:0@lo:503: 00000100:00100000:0.0:1788448377.475911:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.475936:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cb780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.475981:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892544 00000100:00100000:3.0:1788448377.475986:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892544 00000100:00100000:3.0:1788448377.476052:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788448377.476060:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892544:12345-0@lo:503: 00000100:00100000:3.0:1788448377.476243:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892544:12345-0@lo:503: Request processed in 183us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.476251:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788448377.480329:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892544:0@lo:503: 00000100:00100000:3.0:1788448377.480796:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8093:1875323926892672:0@lo:502: 00000100:00100000:3.0:1788448377.480873:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448377.480924:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.480970:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892672 00000100:00100000:1.0:1788448377.480977:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892672 00000100:00100000:1.0:1788448377.481026:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788448377.481037:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8093:x1875323926892672:12345-0@lo:502: 00000100:00100000:1.0:1788448377.481462:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8093:x1875323926892672:12345-0@lo:502: Request processed in 426us (588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.481471:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788448377.481527:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8093:1875323926892672:0@lo:502: 00000100:00100000:1.0:1788448377.481580:0:8093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8093:1875323926892800:0@lo:502: 00000100:00100000:1.0:1788448377.481616:0:8093:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.481641:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892800 00000100:00100000:1.0:1788448377.481645:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892800 00000100:00100000:1.0:1788448377.481669:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448377.481676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8093:x1875323926892800:12345-0@lo:502: 00000100:00100000:1.0:1788448377.481819:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8093:x1875323926892800:12345-0@lo:502: Request processed in 143us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.481825:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448377.481856:0:8093:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.481868:0:8093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8093:1875323926892800:0@lo:502: 00000040:00080000:1.0:1788448377.481895:0:8093:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1788448377.481951:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1788448377.481968:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448377.481979:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.481991:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448377.482002:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448377.482004:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a80badd000 from 5 10000000:01000000:1.0:1788448377.482007:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448377.482034:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482043:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482052:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448377.482065:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892928:0@lo:101: 00000100:00100000:1.0:1788448377.482092:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.482112:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926892928 00000100:00100000:1.0:1788448377.482115:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926892928 00000100:00100000:1.0:1788448377.482136:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788448377.482142:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926892928:12345-0@lo:101: 00010000:00010000:1.0:1788448377.482151:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448377.482164:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810628200/0xd0e9b344b90aadd1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aadca expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482213:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810628200/0xd0e9b344b90aadd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aadca expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482224:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810628200/0xd0e9b344b90aadd1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadca expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482233:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628200, rc 0) 00000100:00100000:1.0:1788448377.482259:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926892928:12345-0@lo:101: Request processed in 117us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.482266:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788448377.482289:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.482300:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926892928:0@lo:101: 00010000:00010000:1.0:1788448377.482312:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.482320:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448377.484676:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893056:0@lo:256: 00000100:00100000:1.0:1788448377.484739:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.484774:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893056 00000100:00100000:1.0:1788448377.484780:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893056 00000100:00100000:1.0:1788448377.484832:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788448377.484842:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926893056:12345-0@lo:256: 20000000:01000000:1.0:1788448377.484860:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788448377.484877:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788448377.484880:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788448377.484974:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926893056:12345-0@lo:256: Request processed in 133us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.484981:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788448377.485021:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a573c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.485040:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893056:0@lo:256: 10000000:01000000:1.0:1788448377.485088:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788448377.485097:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.485107:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448377.485116:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788448377.485119:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1788448377.485122:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788448377.485144:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.485151:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.485161:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448377.485173:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893184:0@lo:101: 00000100:00100000:1.0:1788448377.485236:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.485256:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893184 00000100:00100000:1.0:1788448377.485260:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893184 00000100:00100000:1.0:1788448377.485282:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788448377.485289:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926893184:12345-0@lo:101: 00010000:00010000:1.0:1788448377.485304:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448377.485316:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aadd8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.486315:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.486496:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.486508:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629a00, rc 0) 00000100:00100000:1.0:1788448377.486557:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893184:12345-0@lo:101: Request processed in 1268us (1319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.486564:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788448377.486614:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.486633:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893184:0@lo:101: 00010000:00010000:1.0:1788448377.486648:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448377.486657:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448377.486718:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893312:0@lo:501: 00000100:00100000:1.0:1788448377.486745:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.486771:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893312 00000100:00100000:1.0:1788448377.486776:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893312 00000100:00100000:1.0:1788448377.486815:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788448377.486823:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893312:12345-0@lo:501: 00000100:00100000:1.0:1788448377.487131:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893312:12345-0@lo:501: Request processed in 308us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.487139:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788448377.487165:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.487182:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893312:0@lo:501: 00000100:00100000:1.0:1788448377.489126:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893440:0@lo:503: 00000100:00100000:1.0:1788448377.489210:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.489254:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893440 00000100:00100000:1.0:1788448377.489261:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893440 00000100:00100000:1.0:1788448377.489301:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448377.489310:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893440:12345-0@lo:503: 00000100:00100000:0.0:1788448377.490446:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448377.496869:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893440:12345-0@lo:503: Request processed in 7545us (7644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448377.496886:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448377.497141:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893440:0@lo:503: 00000100:00100000:0.0:1788448377.519498:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8096:1875323926893568:0@lo:502: 00000100:00100000:0.0:1788448377.519597:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.519644:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cbf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.521245:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893568 00000100:00100000:3.0:1788448377.521259:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893568 00000100:00100000:3.0:1788448377.521315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788448377.521335:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8096:x1875323926893568:12345-0@lo:502: 00000100:00100000:3.0:1788448377.521706:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8096:x1875323926893568:12345-0@lo:502: Request processed in 373us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448377.521715:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788448377.522830:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8096:1875323926893568:0@lo:502: 00000020:01000000:0.0:1788448377.522882:0:8096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788448377.522894:0:8096:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1788448377.522973:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448377.522976:0:8096:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788448377.522982:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788448377.522994:0:8096:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:0.0:1788448377.523023:0:8096:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788448377.523026:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788448377.523042:0:8096:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99a8075e99b8) 00000020:00000080:0.0:1788448377.523068:0:8096:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:0.0:1788448377.523074:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788448377.523167:0:8096:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788448377.523173:0:8096:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:0.0:1788448377.523180:0:8096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90aaded 00010000:00080000:0.0:1788448377.523236:0:8096:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a83e5ec000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1788448377.523463:0:8096:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:0.0:1788448377.523822:0:8096:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:0.0:1788448377.523836:0:8096:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788448377.528827:0:8096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448377.529067:0:8096:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448377.529125:0:8096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:0.0:1788448377.529218:0:8096:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788448377.534469:0:8100:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448377.534477:0:8100:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788448377.535612:0:8096:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788448377.535626:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788448377.535658:0:8096:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788448377.535682:0:8096:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90aadf4 00000100:00080000:0.0:1788448377.535694:0:8096:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448377.535699:0:8096:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a83e5ec000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1788448377.535734:0:8096:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a8079a7480 x1875323926893696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448377.535761:0:8096:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:2.0:1788448377.536317:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926893696:0@lo:8: 00000100:00100000:2.0:1788448377.536423:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.536504:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893696 00000100:00100000:2.0:1788448377.536511:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893696 00000100:00100000:2.0:1788448377.536559:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448377.536567:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875323926893696:12345-0@lo:8: 00010000:00080000:2.0:1788448377.536602:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 238 last 0 00000020:00000080:2.0:1788448377.536638:0:6683:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90aadfb 00002000:00100000:2.0:1788448377.537228:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99a83fccc000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788448377.537235:0:6683:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1788448377.537239:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788448377.537485:0:6683:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788448377.537880:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448377.537980:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a83fcce800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448377.538453:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875323926893696:12345-0@lo:8: Request processed in 1883us (2041us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.538463:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788448377.538520:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a7480 x1875323926893696/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448387 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448377.538531:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448377.538539:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1788448377.538548:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788448377.538554:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788448377.538557:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83e5ec000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788448377.538572:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788448377.538578:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926893696:0@lo:8: 00000020:01000000:0.0:1788448377.539030:0:8096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448377.539038:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448377.539048:0:8096:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1788448377.539052:0:8096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448377.539058:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448377.539060:0:8096:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788448377.539063:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788448377.539064:0:8096:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788448377.539102:0:8096:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8096:1875323926893824:0@lo:502: 00000100:00100000:0.0:1788448377.539158:0:8096:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.539209:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893824 00000100:00100000:0.0:1788448377.539216:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893824 00000100:00100000:0.0:1788448377.539258:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788448377.539268:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8096:x1875323926893824:12345-0@lo:502: 00000100:00100000:0.0:1788448377.539509:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8096:x1875323926893824:12345-0@lo:502: Request processed in 242us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.539516:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788448377.539562:0:8096:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.539578:0:8096:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8096:1875323926893824:0@lo:502: 00000020:01000000:0.0:1788448377.539605:0:8096:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448377.539609:0:8096:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448377.539611:0:8096:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1788448377.539614:0:8096:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1788448377.539664:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788448377.539682:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788448377.539692:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539702:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448377.539711:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788448377.539720:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a8065799b8 from 1 10000000:01000000:0.0:1788448377.539723:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788448377.539747:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539754:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539762:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448377.539774:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893952:0@lo:101: 00000100:00100000:0.0:1788448377.539814:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.539831:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.539855:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926893952 00000100:00100000:0.0:1788448377.539859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926893952 00000100:00100000:0.0:1788448377.539884:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448377.539891:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926893952:12345-0@lo:101: 00010000:00010000:0.0:1788448377.539900:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448377.539916:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae02 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539938:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539949:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.539958:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:0.0:1788448377.539987:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926893952:12345-0@lo:101: Request processed in 97us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.540001:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448377.540038:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926893952:0@lo:101: 00010000:00010000:0.0:1788448377.540050:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.540059:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448377.540102:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926894080:0@lo:501: 00000100:00100000:0.0:1788448377.540127:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.540139:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d1cbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.540150:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894080 00000100:00100000:0.0:1788448377.540153:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894080 00000100:00100000:0.0:1788448377.540170:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448377.540176:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926894080:12345-0@lo:501: 00000100:00100000:0.0:1788448377.540418:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926894080:12345-0@lo:501: Request processed in 240us (288us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448377.540424:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788448377.540467:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926894080:0@lo:501: 10000000:01000000:0.0:1788448377.540488:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788448377.540494:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448377.540502:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788448377.543075:0:8100:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1788448377.543134:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926894208:0@lo:400: 00000100:00100000:0.0:1788448377.543236:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788448377.543267:0:8100:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 238150080370ns, next at 0ns, rc = 0 00000100:00100000:0.0:1788448377.543303:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894208 00000100:00100000:0.0:1788448377.543312:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894208 00000100:00100000:0.0:1788448377.543361:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448377.543371:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926894208:12345-0@lo:400: 00000100:00100000:0.0:1788448377.543423:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926894208:12345-0@lo:400: Request processed in 53us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.543430:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:0.0:1788448377.543479:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a5180 x1875323926894208/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.543493:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926894208:0@lo:400: 00000100:00100000:0.0:1788448377.543527:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926894336:0@lo:400: 00000100:00100000:0.0:1788448377.543550:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.543578:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894336 00000100:00100000:0.0:1788448377.543582:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894336 00000100:00100000:0.0:1788448377.543614:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448377.543620:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926894336:12345-0@lo:400: 00000100:00100000:0.0:1788448377.543653:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926894336:12345-0@lo:400: Request processed in 32us (101us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.543658:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788448377.543675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788448377.543697:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a5180 x1875323926894336/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.543707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926894336:0@lo:400: 00000100:00100000:0.0:1788448377.543742:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926894464:0@lo:400: 00000100:00100000:0.0:1788448377.543795:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.543831:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894464 00000100:00100000:0.0:1788448377.543834:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894464 00000100:00100000:0.0:1788448377.544310:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448377.544320:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926894464:12345-0@lo:400: 00000100:00100000:0.0:1788448377.544367:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926894464:12345-0@lo:400: Request processed in 49us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.544374:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1788448377.544395:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448377.544414:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a5180 x1875323926894464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.544425:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926894464:0@lo:400: 00000100:00100000:0.0:1788448377.544462:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926894592:0@lo:400: 00000100:00100000:0.0:1788448377.544491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.544524:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894592 00000100:00100000:0.0:1788448377.544528:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894592 00000100:00100000:0.0:1788448377.544559:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788448377.544566:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926894592:12345-0@lo:400: 00000100:00100000:0.0:1788448377.544603:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926894592:12345-0@lo:400: Request processed in 38us (111us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.544608:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:0.0:1788448377.544626:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788448377.544643:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a5180 x1875323926894592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.544652:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926894592:0@lo:400: 00000004:00080000:2.0:1788448377.588362:0:8101:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788448377.588400:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926894848:0@lo:7: 00000100:00100000:2.0:1788448377.588474:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.588524:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83cd91f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448377.588548:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926894720:0@lo:13: 00000100:00100000:2.0:1788448377.588583:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.588624:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894848 00000100:00100000:2.0:1788448377.588632:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894848 00000100:00080000:1.0:1788448377.588675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448377.588692:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448377.588702:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875323926894848:12345-0@lo:7: 00000100:00100000:0.0:1788448377.590259:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894720 00000100:00100000:0.0:1788448377.590281:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894720 00000100:00100000:0.0:1788448377.590335:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448377.590341:0:6685:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788448377.590345:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926894720:12345-0@lo:13: 00000100:00100000:1.0:1788448377.590350:0:6685:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00002000:00000024:0.0:1788448377.590374:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1788448377.590442:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926894720:12345-0@lo:13: Request processed in 98us (1858us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448377.590448:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1788448377.592382:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4000 x1875323926894720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448377.592410:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926894720:0@lo:13: 00002000:00080000:2.0:1788448377.603826:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788448377.603838:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788448377.604129:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875323926894848:12345-0@lo:7: Request processed in 15422us (15649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.604141:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788448377.604307:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4700 x1875323926894848/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788448393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448377.604323:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926894848:0@lo:7: 00000004:00080000:2.0:1788448377.604339:0:8101:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788448377.604380:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926894976:0@lo:5: 00000100:00100000:2.0:1788448377.604420:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448377.604507:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.611545:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926894976 00000100:00100000:0.0:1788448377.611558:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926894976 00000100:00100000:1.0:1788448377.611704:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448377.611714:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8101:x1875323926894976:12345-0@lo:5: 00002000:00080000:1.0:1788448377.611751:0:6683:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1788448377.611756:0:6683:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1788448377.612274:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:8101:x1875323926894976:12345-0@lo:5: Request processed in 559us (7850us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788448377.612282:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788448377.613060:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4700 x1875323926894976/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.613080:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926894976:0@lo:5: 00000004:00080000:0.0:1788448377.613095:0:8101:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1788448377.613137:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926895104:0@lo:700: 00000100:00100000:0.0:1788448377.613182:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.613254:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757aa80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.613272:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895104 00000100:00100000:0.0:1788448377.613277:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895104 00000100:00100000:0.0:1788448377.613314:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448377.613323:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8101:x1875323926895104:12345-0@lo:700: 00000100:00100000:0.0:1788448377.613354:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875323926895232:0@lo:700: 00000100:00100000:0.0:1788448377.613385:0:6689:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448377.613402:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448377.613419:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895232 00000100:00100000:0.0:1788448377.613422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895232 00000100:00100000:0.0:1788448377.613448:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448377.613455:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875323926895232:12345-0@lo:700: 00000004:00080000:1.0:1788448377.643451:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:3.0:1788448377.690354:0:5844:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:2.0:1788448377.701167:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6689:x1875323926895232:12345-0@lo:700: Request processed in 87699us (87767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.701215:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788448377.701335:0:6689:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a7800 x1875323926895232/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788448393 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.701352:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6689:1875323926895232:0@lo:700: 40000000:02000000:0.0:1788448377.701371:0:6689:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:2.0:1788448377.788487:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8101:x1875323926895104:12345-0@lo:700: Request processed in 175155us (175295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448377.788502:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448377.788602:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8079a5180 x1875323926895104/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788448393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448377.788619:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926895104:0@lo:700: 00000001:00080000:2.0:1788448377.798589:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788448377.798617:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000004:02000040:1.0:1788448377.846798:0:8101:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1788448377.858729:0:8101:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926895360:0@lo:5: 00000100:00100000:1.0:1788448377.858809:0:8101:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448377.858870:0:8101:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448377.858970:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895360 00000100:00100000:3.0:1788448377.858978:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895360 00000100:00100000:3.0:1788448377.859029:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448377.859040:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8101:x1875323926895360:12345-0@lo:5: 00002000:00080000:3.0:1788448377.866352:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788448377.866374:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788448377.875939:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8101:x1875323926895360:12345-0@lo:5: Request processed in 16893us (17121us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788448377.875953:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1788448377.879458:0:8101:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c5c00 x1875323926895360/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448393 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.879474:0:8101:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1788448377.879490:0:8101:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99a7056c5c00 x1875323926895360/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788448393 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448377.879503:0:8101:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8101:1875323926895360:0@lo:5: 00000004:00080000:0.0:1788448377.879520:0:8101:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1788448378.403927:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448379.425762:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788448379.591852:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788448380.151843:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448380.152547:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902754944 00000100:00100000:0.0:1788448380.152568:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902754944 00000100:00100000:0.0:1788448380.152647:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:0.0:1788448380.152659:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2351:x1875323902754944:12345-192.168.204.37@tcp:250: 00010000:00080000:0.0:1788448380.153579:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 188c2354-2939-43ce-85d0-cb78875d8855@192.168.204.37@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:0.0:1788448380.153624:0:5829:0:(genops.c:1385:class_connect()) connect: client 188c2354-2939-43ce-85d0-cb78875d8855, cookie 0xd0e9b344b90aae10 00000100:00080000:2.0:1788448380.154932:0:5829:0:(import.c:65:import_set_state_nolock()) ffff99a83fcca800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448380.155045:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+5:2351:x1875323902754944:12345-192.168.204.37@tcp:250: Request processed in 2385us (3216us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448380.155057:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:0.0:1788448380.159948:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.160418:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755072 00000100:00100000:3.0:1788448380.160433:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755072 00000100:00100000:3.0:1788448380.160510:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:3.0:1788448380.160524:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+5:5579:x1875323902755072:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1788448380.160549:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448380.160590:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05108b4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.160628:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.160653:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 6 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.160664:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246800, rc 0) 00000100:00100000:3.0:1788448380.160754:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+6:5579:x1875323902755072:12345-192.168.204.37@tcp:101: Request processed in 233us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.160763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:3.0:1788448380.174102:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.174703:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755200 00000100:00100000:3.0:1788448380.174716:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755200 00000100:00100000:3.0:1788448380.174801:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:3.0:1788448380.174815:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+6:5579:x1875323902755200:12345-192.168.204.37@tcp:501: 00000100:00100000:3.0:1788448380.177112:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+6:5579:x1875323902755200:12345-192.168.204.37@tcp:501: Request processed in 2280us (3005us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448380.177133:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:0.0:1788448380.185568:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.185661:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755328 00000100:00100000:3.0:1788448380.185675:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755328 00000100:00100000:3.0:1788448380.185803:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:3.0:1788448380.185816:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+6:5579:x1875323902755328:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1788448380.185839:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448380.185861:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05108bb expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.185917:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.185955:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 7 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.185966:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247600, rc 0) 00000100:00100000:3.0:1788448380.186043:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+7:5579:x1875323902755328:12345-192.168.204.37@tcp:101: Request processed in 230us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.186050:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:2.0:1788448380.193813:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.194102:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755456 00000100:00100000:3.0:1788448380.194115:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755456 00000100:00100000:3.0:1788448380.194225:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:3.0:1788448380.194239:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+7:5579:x1875323902755456:12345-192.168.204.37@tcp:501: 00000100:00100000:3.0:1788448380.195474:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:5579:x1875323902755456:12345-192.168.204.37@tcp:501: Request processed in 1229us (1670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.195488:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:0.0:1788448380.199576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.199700:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755584 00000100:00100000:3.0:1788448380.199714:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755584 00000100:00100000:3.0:1788448380.199793:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:3.0:1788448380.199806:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+8:5579:x1875323902755584:12345-192.168.204.37@tcp:503: 00000100:00100000:3.0:1788448380.201512:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+8:5579:x1875323902755584:12345-192.168.204.37@tcp:503: Request processed in 1693us (1939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.201528:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:1.0:1788448380.207839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.208619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755712 00000100:00100000:3.0:1788448380.208635:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755712 00000100:00100000:3.0:1788448380.208713:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:3.0:1788448380.208727:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:5597:x1875323902755712:12345-192.168.204.37@tcp:502: 00000100:00100000:3.0:1788448380.209594:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:5597:x1875323902755712:12345-192.168.204.37@tcp:502: Request processed in 863us (1763us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.209605:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:0.0:1788448380.252939:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448380.253951:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755840 00000100:00100000:2.0:1788448380.253970:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755840 00000100:00100000:2.0:1788448380.254476:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:2.0:1788448380.254499:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+8:5597:x1875323902755840:12345-192.168.204.37@tcp:502: 00000100:00100000:2.0:1788448380.256792:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+8:5597:x1875323902755840:12345-192.168.204.37@tcp:502: Request processed in 2281us (3850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448380.267097:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:1.0:1788448380.271099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448380.271214:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902755968 00000100:00100000:0.0:1788448380.271228:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902755968 00000100:00100000:3.0:1788448380.271414:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1788448380.271430:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:5579:x1875323902755968:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1788448380.271457:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448380.271483:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247400/0xd0e9b344b90aae25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05108e5 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.271521:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247400/0xd0e9b344b90aae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108e5 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.271534:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247400/0xd0e9b344b90aae25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108e5 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448380.271545:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247400, rc 0) 00000100:00100000:3.0:1788448380.271631:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+9:5579:x1875323902755968:12345-192.168.204.37@tcp:101: Request processed in 205us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.271638:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:1.0:1788448380.277682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448380.277799:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756096 00000100:00100000:0.0:1788448380.277834:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756096 00000100:00100000:0.0:1788448380.277911:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:0.0:1788448380.277925:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+9:5579:x1875323902756096:12345-192.168.204.37@tcp:256: 20000000:01000000:0.0:1788448380.277963:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788448380.277986:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788448380.277991:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788448380.277994:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788448380.277997:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1788448380.281603:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+9:5579:x1875323902756096:12345-192.168.204.37@tcp:256: Request processed in 3658us (3913us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448380.281627:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:1.0:1788448380.286259:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448380.286645:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756224 00000100:00100000:0.0:1788448380.286661:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756224 00000100:00100000:0.0:1788448380.286753:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:0.0:1788448380.286766:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:5579:x1875323902756224:12345-192.168.204.37@tcp:101: 00010000:00010000:0.0:1788448380.286791:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448380.286817:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05108ec expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448380.286865:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448380.286881:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448380.286894:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed200, rc 0) 00000100:00100000:0.0:1788448380.286991:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5579:x1875323902756224:12345-192.168.204.37@tcp:101: Request processed in 228us (749us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448380.286999:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:0.0:1788448380.294571:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448380.295297:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756352 00000100:00100000:1.0:1788448380.295324:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756352 00000100:00100000:1.0:1788448380.295444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:1.0:1788448380.295459:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5579:x1875323902756352:12345-192.168.204.37@tcp:501: 00000100:00100000:1.0:1788448380.295892:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5579:x1875323902756352:12345-192.168.204.37@tcp:501: Request processed in 435us (1335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448380.295902:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:0.0:1788448380.298667:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.298951:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756480 00000100:00100000:3.0:1788448380.298966:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756480 00000100:00100000:3.0:1788448380.299033:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:3.0:1788448380.299048:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:5579:x1875323902756480:12345-192.168.204.37@tcp:503: 00000100:00100000:3.0:1788448380.299579:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:5579:x1875323902756480:12345-192.168.204.37@tcp:503: Request processed in 531us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.299589:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:0.0:1788448380.303602:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448380.304722:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756608 00000100:00100000:1.0:1788448380.304749:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756608 00000100:00100000:1.0:1788448380.304834:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:1.0:1788448380.305412:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5601:x1875323902756608:12345-192.168.204.37@tcp:502: 00000100:00100000:1.0:1788448380.306654:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5601:x1875323902756608:12345-192.168.204.37@tcp:502: Request processed in 1796us (3057us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448380.306667:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:0.0:1788448380.312962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448380.321468:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756736 00000100:00100000:3.0:1788448380.321495:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756736 00000100:00100000:3.0:1788448380.321588:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:3.0:1788448380.322387:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5601:x1875323902756736:12345-192.168.204.37@tcp:502: 00000100:00100000:3.0:1788448380.325110:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5601:x1875323902756736:12345-192.168.204.37@tcp:502: Request processed in 2794us (12142us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448380.325129:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:1.0:1788448380.339021:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448380.339114:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756864 00000100:00100000:2.0:1788448380.339128:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756864 00000100:00100000:2.0:1788448380.339233:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1788448380.339246:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1875323902756864:12345-192.168.204.37@tcp:38: 00010000:00080000:2.0:1788448380.339287:0:7154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 240 last 0 00000020:00000080:2.0:1788448380.339369:0:7154:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90aae33 00000004:00100000:2.0:1788448380.339410:0:7154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1788448380.339417:0:7154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1788448380.389177:0:7154:0:(import.c:65:import_set_state_nolock()) ffff99a83fccc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448380.389333:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902756864:12345-192.168.204.37@tcp:38: Request processed in 50087us (50325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448380.389349:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00010000:00010000:2.0:1788448380.448781:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448380.514285:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448380.514325:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926895488:0@lo:13: 00000100:00100000:3.0:1788448380.514433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448380.514686:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895488 00000100:00100000:0.0:1788448380.514699:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895488 00000100:00100000:0.0:1788448380.514799:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448380.514810:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926895488:12345-0@lo:13: 00002000:00000024:0.0:1788448380.515525:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448380.515632:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926895488:12345-0@lo:13: Request processed in 820us (1195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448380.515643:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788448380.515678:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448380.515904:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c6680 x1875323926895488/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448396 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448380.515934:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926895488:0@lo:13: 00000100:00100000:1.0:1788448381.397689:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448381.397754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448381.397870:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757120 00000100:00100000:0.0:1788448381.397884:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757120 00000100:00100000:2.0:1788448381.397921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902756992 00000100:00100000:2.0:1788448381.397943:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902756992 00000100:00080000:1.0:1788448381.397994:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448381.398026:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1788448381.398040:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:5579:x1875323902757120:12345-192.168.204.37@tcp:41: 00000004:00000024:0.0:1788448381.398107:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788448381.398167:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1788448381.398176:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:0:x1875323902756992:12345-192.168.204.37@tcp:41: 00000100:00100000:0.0:1788448381.398222:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:5579:x1875323902757120:12345-192.168.204.37@tcp:41: Request processed in 185us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448381.398231:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000004:00000024:2.0:1788448381.401482:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1788448381.401923:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:0:x1875323902756992:12345-192.168.204.37@tcp:41: Request processed in 3739us (4158us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448381.401936:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1788448381.402048:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448381.403760:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757248 00000100:00100000:0.0:1788448381.403779:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757248 00000100:00100000:0.0:1788448381.404270:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448381.404286:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:5579:x1875323902757248:12345-192.168.204.37@tcp:40: 00000100:00100000:0.0:1788448381.404426:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:5579:x1875323902757248:12345-192.168.204.37@tcp:40: Request processed in 143us (2376us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448381.404434:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1788448381.410671:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448381.410802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448381.410838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448381.410898:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448381.410935:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757376 00000100:00100000:1.0:1788448381.410949:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757376 00000100:00100000:1.0:1788448381.410998:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757504 00000100:00100000:1.0:1788448381.411002:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757504 00000100:00100000:1.0:1788448381.411019:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:1.0:1788448381.411029:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902757376:12345-192.168.204.37@tcp:8: 00010000:00080000:1.0:1788448381.411075:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788448381.411358:0:6683:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90aae3a 00002000:00100000:1.0:1788448381.411375:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af250c24-64ec-487b-a1ec-11a62017775a/ffff99a704f18800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448381.411390:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788448381.412063:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757760 00000100:00100000:2.0:1788448381.412074:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757760 00000100:00100000:2.0:1788448381.412153:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:2.0:1788448381.412164:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902757760:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1788448381.412299:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902757760:12345-192.168.204.37@tcp:400: Request processed in 136us (1400us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448381.412307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 126 00002000:00080000:1.0:1788448381.413513:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788448381.413600:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a704f1c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448381.413689:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902757376:12345-192.168.204.37@tcp:8: Request processed in 2656us (2882us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448381.413701:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:1.0:1788448381.413746:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1788448381.413753:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902757504:12345-192.168.204.37@tcp:8: 00010000:00080000:1.0:1788448381.413785:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 242 last 0 00000020:00000080:1.0:1788448381.413818:0:6683:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90aae41 00002000:00100000:1.0:1788448381.417285:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af250c24-64ec-487b-a1ec-11a62017775a/ffff99a704f1d800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448381.417339:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448381.417862:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788448381.417919:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a704f1f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448381.418006:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902757504:12345-192.168.204.37@tcp:8: Request processed in 4250us (7166us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448381.418019:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:3.0:1788448381.422806:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757632 00000100:00100000:3.0:1788448381.422824:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757632 00000100:00100000:3.0:1788448381.422901:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:3.0:1788448381.422913:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:5579:x1875323902757632:12345-192.168.204.37@tcp:33: 00000004:00080000:3.0:1788448381.439994:0:5840:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 16989us 00000004:00200000:3.0:1788448381.450841:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788448381.451006:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:5579:x1875323902757632:12345-192.168.204.37@tcp:33: Request processed in 28087us (40344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448381.451020:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00010000:00010000:0.0:1788448381.472373:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448381.605136:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448381.606443:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902757888 00000100:00100000:0.0:1788448381.606483:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902757888 00000100:00100000:0.0:1788448381.606585:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448381.606598:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:5618:x1875323902757888:12345-192.168.204.37@tcp:101: 00010000:00010000:0.0:1788448381.606626:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448381.606665:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90aae48 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510916 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606768:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606788:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606808:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448381.606857:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788448381.606862:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448381.606882:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606916:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90aae48 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510916 expref: 8 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606939:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510916 expref: 7 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448381.606948:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448381.606952:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448381.606956:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec800, rc 0) 00000100:00100000:0.0:1788448381.607070:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:5618:x1875323902757888:12345-192.168.204.37@tcp:101: Request processed in 473us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448381.607077:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00010000:00010000:2.0:1788448382.496509:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448382.560767:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926895616:0@lo:400: 00000100:00100000:2.0:1788448382.560881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.560971:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926896128:0@lo:400: 00000100:00100000:2.0:1788448382.561004:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.561025:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788448382.561030:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926895744:0@lo:400: 00000100:00100000:2.0:1788448382.561055:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.561091:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926896256:0@lo:400: 00000100:00100000:2.0:1788448382.561122:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.561163:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896000:0@lo:400: 00000100:00100000:2.0:1788448382.561248:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.561269:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448382.561276:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926895872:0@lo:400: 00000100:00100000:2.0:1788448382.561302:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448382.561338:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896256 00000100:00100000:2.0:1788448382.561350:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896256 00000100:00100000:2.0:1788448382.561421:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896000 00000100:00100000:2.0:1788448382.561425:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896000 00000100:00100000:2.0:1788448382.561450:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448382.561461:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926896256:12345-0@lo:400: 00000100:00100000:2.0:1788448382.561527:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926896256:12345-0@lo:400: Request processed in 68us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.561535:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448382.561554:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448382.561560:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896000:12345-0@lo:400: 00000100:00100000:2.0:1788448382.561591:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896000:12345-0@lo:400: Request processed in 32us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.561597:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788448382.561639:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce36680 x1875323926896000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.561655:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896000:0@lo:400: 00010000:00080000:2.0:1788448382.561700:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce36300 x1875323926896256/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448398 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448382.561708:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788448382.561721:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926896256:0@lo:400: 00000100:00100000:2.0:1788448382.561771:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896128 00000100:00100000:2.0:1788448382.561776:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896128 00000100:00100000:2.0:1788448382.561811:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895744 00000100:00100000:2.0:1788448382.561815:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895744 00000100:00100000:2.0:1788448382.561828:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895872 00000100:00100000:2.0:1788448382.561831:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895872 00000100:00100000:2.0:1788448382.561848:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788448382.561918:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448382.561928:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926895744:12345-0@lo:400: 00000100:00080000:1.0:1788448382.562023:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448382.562029:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448382.562032:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448382.562038:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926895744:12345-0@lo:400: Request processed in 112us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.562044:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448382.562076:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448382.562082:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926895872:12345-0@lo:400: 00000100:00100000:0.0:1788448382.562130:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926895872:12345-0@lo:400: Request processed in 48us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448382.562136:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788448382.562370:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926896128:12345-0@lo:400: 00000100:00100000:2.0:1788448382.562410:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926896128:12345-0@lo:400: Request processed in 556us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448382.562417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788448382.562451:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926895744:0@lo:400: 00000100:00100000:2.0:1788448382.562464:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce37b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926896128:0@lo:400: 00000100:00100000:1.0:1788448382.562549:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926895872:0@lo:400: 00000100:00100000:3.0:1788448382.562978:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926895616 00000100:00100000:3.0:1788448382.562987:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926895616 00000100:00100000:3.0:1788448382.563036:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788448382.563046:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926895616:12345-0@lo:400: 00000100:00100000:2.0:1788448382.566983:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926895616:0@lo:400: 00000100:00100000:3.0:1788448382.567945:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926895616:12345-0@lo:400: Request processed in 3752us (5917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448382.567963:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788448383.073025:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448383.079529:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896384:0@lo:13: 00000100:00100000:1.0:1788448383.079651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448383.080064:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896384 00000100:00100000:0.0:1788448383.080084:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896384 00000100:00100000:0.0:1788448383.080157:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448383.080167:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896384:12345-0@lo:13: 00002000:00000024:0.0:1788448383.080242:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448383.080309:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896384:12345-0@lo:13: Request processed in 143us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448383.080317:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788448383.081541:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807975f80 x1875323926896384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448383.081577:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896384:0@lo:13: 00010000:00010000:0.0:1788448383.520690:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448383.779685:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000100:00100000:2.0:1788448383.916635:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448383.918656:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758016 00000100:00100000:0.0:1788448383.918689:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758016 00000100:00100000:0.0:1788448383.918821:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1788448383.918835:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:5670:x1875323902758016:12345-192.168.204.37@tcp:41: 00000004:00000024:0.0:1788448383.918908:0:7154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1788448383.919126:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:5670:x1875323902758016:12345-192.168.204.37@tcp:41: Request processed in 293us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448383.919134:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00080000:1.0:1788448383.919448:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448383.929490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448383.929630:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758144 00000100:00100000:0.0:1788448383.929645:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758144 00000100:00100000:0.0:1788448383.929772:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448383.929797:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af250c24-64ec-487b-a1ec-11a62017775a+5:5670:x1875323902758144:12345-192.168.204.37@tcp:13: 00002000:00000024:0.0:1788448383.929853:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448383.929959:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af250c24-64ec-487b-a1ec-11a62017775a+5:5670:x1875323902758144:12345-192.168.204.37@tcp:13: Request processed in 166us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448383.929968:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00080000:1.0:1788448383.931332:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448383.936682:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448383.945048:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758272 00000100:00100000:2.0:1788448383.945069:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758272 00000100:00100000:2.0:1788448383.945179:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1788448383.945225:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af250c24-64ec-487b-a1ec-11a62017775a+6:5670:x1875323902758272:12345-192.168.204.37@tcp:13: 00002000:00000024:2.0:1788448383.945278:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448383.945379:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:af250c24-64ec-487b-a1ec-11a62017775a+6:5670:x1875323902758272:12345-192.168.204.37@tcp:13: Request processed in 157us (8724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448383.945388:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00080000:1.0:1788448383.948147:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788448384.546634:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448385.568362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448385.632584:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896512:0@lo:13: 00000100:00100000:2.0:1788448385.632675:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448385.632811:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896512 00000100:00100000:1.0:1788448385.632820:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896512 00000100:00100000:1.0:1788448385.632891:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448385.632901:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896512:12345-0@lo:13: 00002000:00000024:1.0:1788448385.632940:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448385.632989:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926896512:12345-0@lo:13: Request processed in 89us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448385.632995:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788448385.633034:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c5500 x1875323926896512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448401 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448385.633052:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926896512:0@lo:13: 00000100:00080000:2.0:1788448385.633115:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788448385.692685:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000001:00100000:3.0:1788448385.694875:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000100:00100000:3.0:1788448386.485722:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448386.485766:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448386.485805:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448386.485835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448386.485863:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758400 00000100:00100000:3.0:1788448386.485874:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758400 00000100:00100000:3.0:1788448386.485928:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:3.0:1788448386.485940:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902758400:12345-192.168.204.37@tcp:400: 00000100:00100000:0.0:1788448386.486072:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758784 00000100:00100000:0.0:1788448386.486078:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758784 00000100:00100000:0.0:1788448386.486133:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758656 00000100:00100000:0.0:1788448386.486137:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758656 00000100:00100000:0.0:1788448386.486154:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448386.486161:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902758784:12345-192.168.204.37@tcp:400: 00000100:00100000:0.0:1788448386.486245:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902758784:12345-192.168.204.37@tcp:400: Request processed in 83us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448386.486253:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448386.486271:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448386.486278:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902758656:12345-192.168.204.37@tcp:400: 00000100:00100000:0.0:1788448386.486305:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902758656:12345-192.168.204.37@tcp:400: Request processed in 27us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448386.486327:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1788448386.486494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758528 00000100:00100000:2.0:1788448386.486499:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758528 00000100:00100000:3.0:1788448386.486540:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902758400:12345-192.168.204.37@tcp:400: Request processed in 603us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448386.486541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1788448386.486548:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:2.0:1788448386.486550:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902758528:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1788448386.486579:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902758528:12345-192.168.204.37@tcp:400: Request processed in 32us (868us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448386.486584:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00080000:2.0:1788448386.486600:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448386.486605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448386.486607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788448386.595128:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448386.831061:0:8289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1788448387.617068:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448387.681425:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926896640:0@lo:400: 00000100:00100000:2.0:1788448387.681500:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681548:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926897152:0@lo:400: 00000100:00100000:2.0:1788448387.681574:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681615:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788448387.681622:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926896768:0@lo:400: 00000100:00100000:2.0:1788448387.681645:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681662:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926897280:0@lo:400: 00000100:00100000:2.0:1788448387.681686:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681712:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926896896:0@lo:400: 00000100:00100000:2.0:1788448387.681735:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681752:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448387.681758:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926897024:0@lo:400: 00000100:00100000:2.0:1788448387.681777:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448387.681806:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896640 00000100:00100000:2.0:1788448387.681818:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896640 00000100:00100000:2.0:1788448387.681868:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788448387.681877:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926896640:12345-0@lo:400: 00000100:00100000:2.0:1788448387.681929:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926896640:12345-0@lo:400: Request processed in 53us (428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.681937:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1788448387.681970:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897152 00000100:00100000:2.0:1788448387.681974:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897152 00000100:00100000:2.0:1788448387.682006:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896768 00000100:00100000:2.0:1788448387.682009:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896768 00000100:00100000:2.0:1788448387.682020:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926896896 00000100:00100000:2.0:1788448387.682023:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926896896 00000100:00100000:2.0:1788448387.682038:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448387.682044:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926897152:12345-0@lo:400: 00000100:00100000:2.0:1788448387.682091:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926897152:12345-0@lo:400: Request processed in 47us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.682097:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448387.682109:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448387.682116:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926896768:12345-0@lo:400: 00000100:00100000:2.0:1788448387.682142:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926896768:12345-0@lo:400: Request processed in 28us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.682148:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448387.682160:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448387.682166:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926896896:12345-0@lo:400: 00000100:00100000:2.0:1788448387.682224:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926896896:12345-0@lo:400: Request processed in 57us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.682230:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448387.682259:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897280 00000100:00100000:2.0:1788448387.682263:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897280 00000100:00100000:2.0:1788448387.682288:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897024 00000100:00100000:2.0:1788448387.682291:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897024 00000100:00100000:2.0:1788448387.682307:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448387.682313:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926897280:12345-0@lo:400: 00000100:00100000:2.0:1788448387.682343:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926897280:12345-0@lo:400: Request processed in 31us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.682349:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448387.682360:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448387.682366:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926897024:12345-0@lo:400: 00000100:00100000:2.0:1788448387.682390:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926897024:12345-0@lo:400: Request processed in 25us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448387.682396:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:2.0:1788448387.682421:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448387.682425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448387.682427:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788448387.682458:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e5f80 x1875323926897024/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448387.682473:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926897024:0@lo:400: 00000100:00100000:2.0:1788448387.682484:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926896896:0@lo:400: 00000100:00100000:2.0:1788448387.682513:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926896768:0@lo:400: 00010000:00080000:2.0:1788448387.682523:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e5500 x1875323926897280/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448403 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448387.682532:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926897280:0@lo:400: 00000100:00100000:2.0:1788448387.682540:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926896640:0@lo:400: 00000100:00100000:2.0:1788448387.682560:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926897152:0@lo:400: 00000100:00100000:1.0:1788448388.198084:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448388.198127:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926897408:0@lo:13: 00000100:00100000:1.0:1788448388.198253:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448388.198641:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897408 00000100:00100000:2.0:1788448388.198653:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897408 00000100:00100000:2.0:1788448388.198744:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448388.198758:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926897408:12345-0@lo:13: 00002000:00000024:2.0:1788448388.198823:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448388.198904:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926897408:12345-0@lo:13: Request processed in 149us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448388.198914:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:2.0:1788448388.198977:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e4a80 x1875323926897408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448388.199004:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926897408:0@lo:13: 00010000:00010000:1.0:1788448388.640898:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448389.665427:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788448390.389808:0:8437:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe2ca7aa50 20000000:00000080:0.0:1788448390.389824:0:8437:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a83cdca000 uarg=0000000000000000 20000000:01000000:0.0:1788448390.389910:0:8437:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1788448390.389912:0:8437:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1788448390.389914:0:8437:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788448390.389919:0:8437:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1788448390.389923:0:8437:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1788448390.389936:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1788448390.389938:0:8437:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1788448390.390127:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788448390.390130:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788448390.391454:0:8438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1788448390.392607:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1788448390.392687:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1788448390.392726:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1788448390.392742:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1788448390.392746:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788448390.393681:0:8439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1788448390.394095:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1788448390.394160:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1788448390.394524:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1788448390.394551:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788448390.394554:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1788448390.395781:0:8440:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1788448390.396576:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1788448390.396702:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1788448390.396763:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1788448390.396781:0:8437:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788448390.396849:0:8437:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788448390.399458:0:8441:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:3.0:1788448390.401957:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:3.0:1788448390.402067:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:3.0:1788448390.402109:0:8437:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:3.0:1788448390.402133:0:8437:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788448390.402153:0:8437:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402171:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402444:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402452:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402459:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402466:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402473:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402481:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402491:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402508:0:8437:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402515:0:8437:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402568:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402595:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 9 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.402612:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897536:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448390.402971:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.402981:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.402990:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897664:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448390.403023:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403031:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403040:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897792:0@lo:104: 00000100:00100000:3.0:1788448390.403080:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448390.403117:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403125:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403134:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897920:0@lo:104: 00000100:00100000:3.0:1788448390.403158:0:8437:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448390.403237:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403245:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 18 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403253:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898048:0@lo:104: 00010000:00010000:3.0:1788448390.403281:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403289:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403296:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898176:0@lo:104: 00010000:00010000:3.0:1788448390.403336:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403345:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 18 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403353:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898304:0@lo:104: 00010000:00010000:3.0:1788448390.403377:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403383:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 18 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403390:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898432:0@lo:104: 00010000:00010000:3.0:1788448390.403412:0:8437:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.403430:0:8437:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.403439:0:8437:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898560:0@lo:104: 00000100:00100000:3.0:1788448390.403461:0:8437:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448390.403770:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788448390.403792:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448390.403806:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448390.403814:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448390.403822:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448390.403829:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448390.403838:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897792 00000100:00100000:2.0:1788448390.403845:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897792 00000100:00100000:0.0:1788448390.403858:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926897920 00000100:00100000:0.0:1788448390.403862:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926897920 00000100:00100000:2.0:1788448390.403885:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898176 00000100:00100000:0.0:1788448390.403885:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898048 00000100:00100000:2.0:1788448390.403888:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898176 00000100:00100000:0.0:1788448390.403888:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898048 00000100:00100000:2.0:1788448390.403897:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898304 00000100:00100000:0.0:1788448390.403897:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898432 00000100:00100000:2.0:1788448390.403899:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898304 00000100:00100000:0.0:1788448390.403899:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898432 00000100:00100000:2.0:1788448390.403907:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898560 00000100:00100000:2.0:1788448390.403909:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898560 00000100:00100000:2.0:1788448390.403919:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448390.403933:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:8437:x1875323926897792:12345-0@lo:104: 00010000:00010000:2.0:1788448390.403956:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448390.404014:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448390.404021:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+9:8437:x1875323926897792:12345-0@lo:104: Request processed in 96us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.404117:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897792:0@lo:104: 00010000:00010000:1.0:1788448390.404198:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448390.404205:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.404213:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed800 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448390.404217:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.404236:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448390.404243:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448390.404249:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448390.404286:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.404293:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788448390.404337:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926898688:0@lo:103: 00000100:00100000:3.0:1788448390.404368:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448390.405034:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.405044:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a8092ed800/0xd0e9b344b90aae02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aae09 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.405058:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.405060:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.405062:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448390.405077:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898688 00000100:00100000:1.0:1788448390.405083:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898688 00010000:00010000:1.0:1788448390.405108:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.405142:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448390.405151:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926898688:12345-0@lo:103: 00010000:00010000:1.0:1788448390.405161:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448390.405167:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.405209:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.405226:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aae09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aae02 expref: 19 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.405241:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448390.405293:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3310:x1875323926898688:12345-0@lo:103: Request processed in 143us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448390.405300:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448390.405527:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926898688:0@lo:103: 00000100:00100000:2.0:1788448390.406337:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788448390.406369:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448390.406382:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+8:8437:x1875323926897920:12345-0@lo:104: 00010000:00010000:2.0:1788448390.406395:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.406643:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897920:0@lo:104: 00010000:00010000:1.0:1788448390.407306:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448390.407313:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407322:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448390.407326:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407334:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448390.407341:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448390.407347:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448390.407432:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407439:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448390.407489:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407503:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90aadd8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaddf expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407515:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.407517:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.407519:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448390.407528:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448390.407558:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926898816:0@lo:103: 00000100:00100000:1.0:1788448390.407604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448390.407674:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898816 00000100:00100000:1.0:1788448390.407680:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898816 00010000:00010000:1.0:1788448390.407703:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.407738:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448390.407746:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3312:x1875323926898816:12345-0@lo:103: 00010000:00010000:1.0:1788448390.407756:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448390.407761:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407770:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407922:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629a00/0xd0e9b344b90aaddf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aadd8 expref: 18 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.407936:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448390.407974:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3312:x1875323926898816:12345-0@lo:103: Request processed in 229us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448390.407981:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448390.408011:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926898816:0@lo:103: 00010000:00010000:2.0:1788448390.408338:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788448390.408347:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f59c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+8:8437:x1875323926897920:12345-0@lo:104: Request processed in 1970us (5188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448390.408354:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448390.408397:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448390.408405:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:8437:x1875323926898176:12345-0@lo:104: 00010000:00010000:2.0:1788448390.408415:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448390.408579:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448390.408585:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+7:8437:x1875323926898176:12345-0@lo:104: Request processed in 183us (4778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448390.408592:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788448390.408607:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448390.408614:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:8437:x1875323926898048:12345-0@lo:104: 00000100:00100000:3.0:1788448390.408622:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898176:0@lo:104: 00010000:00010000:2.0:1788448390.408642:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.408720:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898048:0@lo:104: 00010000:00010000:1.0:1788448390.408843:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448390.408850:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408858:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448390.408862:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408875:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448390.408883:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448390.408888:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448390.408925:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408932:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448390.408946:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448390.408951:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926898944:0@lo:103: 00010000:00010000:1.0:1788448390.408953:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a8092ec600/0xd0e9b344b90aadae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadb5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408965:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448390.408973:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408979:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed000 already unused, calling callback (ffffffffc1c4ac20) 00000100:00100000:0.0:1788448390.408980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:1.0:1788448390.408982:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.408989:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448390.408995:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448390.409000:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448390.409013:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448390.409016:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926898944 00010000:00010000:1.0:1788448390.409018:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448390.409020:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926898944 00010000:00010000:1.0:1788448390.409032:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409038:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a8092ed000/0xd0e9b344b90aadbc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aadc3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.409040:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 17 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409047:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.409049:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.409051:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448390.409060:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788448390.409061:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448390.409067:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3312:x1875323926898944:12345-0@lo:103: 00000100:00100000:1.0:1788448390.409068:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926899072:0@lo:103: 00010000:00010000:0.0:1788448390.409076:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448390.409081:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 17 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.409090:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 17 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.409092:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448390.409103:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aadb5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aadae expref: 17 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.409113:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899072 00010000:00010000:0.0:1788448390.409113:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448390.409121:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899072 00010000:00010000:1.0:1788448390.409136:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 17 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448390.409152:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3312:x1875323926898944:12345-0@lo:103: Request processed in 85us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448390.409155:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448390.409158:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448390.409160:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3310:x1875323926899072:12345-0@lo:103: 00010000:00010000:1.0:1788448390.409167:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448390.409171:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 16 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409179:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 16 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448390.409206:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926898944:0@lo:103: 00010000:00010000:1.0:1788448390.409213:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247c00/0xd0e9b344b90aadc3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aadbc expref: 16 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409222:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448390.409254:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3310:x1875323926899072:12345-0@lo:103: Request processed in 94us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448390.409261:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448390.409320:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926899072:0@lo:103: 00010000:00010000:2.0:1788448390.409353:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788448390.409359:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+6:8437:x1875323926898048:12345-0@lo:104: Request processed in 746us (5566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448390.409366:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448390.409384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448390.409391:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:8437:x1875323926898304:12345-0@lo:104: 00010000:00010000:2.0:1788448390.409399:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.409403:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897536:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448390.409412:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926897664:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448390.409450:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448390.409455:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409461:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448390.409464:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409471:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.409583:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898304:0@lo:104: 00010000:00010000:2.0:1788448390.409593:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788448390.409599:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:8437:x1875323926898304:12345-0@lo:104: Request processed in 209us (5783us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448390.409605:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448390.409620:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 10000000:00010000:1.0:1788448390.409707:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448390.409712:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788448390.409739:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409745:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448390.409758:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409764:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629000/0xd0e9b344b90aada0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aada7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.409775:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.409777:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448390.409779:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448390.409859:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:8437:x1875323926898432:12345-0@lo:104: 00010000:00010000:2.0:1788448390.409868:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.410023:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448390.410034:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926899200:0@lo:103: 00000100:00100000:3.0:1788448390.410048:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898432:0@lo:104: 00000100:00100000:1.0:1788448390.410062:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448390.410124:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448390.410130:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:8437:x1875323926898432:12345-0@lo:104: Request processed in 274us (6306us total) trans 0 rc 0/0 00010000:00010000:0.0:1788448390.410133:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1788448390.410136:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788448390.410138:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448390.410151:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788448390.410155:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178a00 already unused, calling callback (ffffffffc1c4ac20) 00000100:00100000:2.0:1788448390.410157:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:8437:x1875323926898560:12345-0@lo:104: 10000000:00010000:0.0:1788448390.410159:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410166:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448390.410169:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448390.410173:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448390.410178:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448390.410219:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448390.410225:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:8437:x1875323926898560:12345-0@lo:104: Request processed in 68us (6394us total) trans 0 rc 0/0 00010000:00010000:0.0:1788448390.410229:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448390.410231:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1788448390.410235:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448390.410247:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410253:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90aad76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad7d expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410262:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448390.410266:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410272:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448390.410275:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410292:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448390.410298:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.410302:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926899328:0@lo:103: 10000000:01000000:0.0:1788448390.410303:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448390.410317:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410323:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448390.410328:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410335:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90aad4c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad53 expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448390.410348:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448390.410350:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448390.410351:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448390.410374:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926899456:0@lo:103: 00000100:00100000:0.0:1788448390.410400:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448390.411128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448390.411172:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448390.411260:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899200 00000100:00100000:2.0:1788448390.411267:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899200 00010000:00010000:2.0:1788448390.411294:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 15 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448390.411351:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899456 00000100:00100000:2.0:1788448390.411355:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899456 00010000:00010000:2.0:1788448390.411369:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 16 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.411398:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899328 00000100:00100000:1.0:1788448390.411402:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899328 00010000:00010000:1.0:1788448390.411416:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 17 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448390.411430:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448390.411448:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3309:x1875323926899200:12345-0@lo:103: 00010000:00010000:1.0:1788448390.411458:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448390.411464:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 17 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.411473:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 17 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.411488:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178c00/0xd0e9b344b90aada7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aada0 expref: 17 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448390.411602:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448390.411653:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3309:x1875323926899200:12345-0@lo:103: Request processed in 207us (1589us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.415989:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448390.416017:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3312:x1875323926899456:12345-0@lo:103: 00010000:00010000:3.0:1788448390.416037:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448390.416047:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 16 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.416062:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 16 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.416100:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448390.416204:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3312:x1875323926899456:12345-0@lo:103: Request processed in 202us (5801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.416212:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448390.416264:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448390.416274:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804616050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3311:x1875323926899328:12345-0@lo:103: 00010000:00010000:3.0:1788448390.416285:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448390.416290:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 15 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.416299:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 15 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.416315:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aad7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aad76 expref: 15 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.416328:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448390.416362:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804616050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3311:x1875323926899328:12345-0@lo:103: Request processed in 92us (5236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.416372:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1788448390.416444:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246400/0xd0e9b344b90aad53 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aad4c expref: 13 pid: 5829 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.416454:0:8437:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8437:1875323926898560:0@lo:104: 00010000:00010000:3.0:1788448390.416519:0:8437:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.417256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448390.417297:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448390.417318:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902758912 00000100:00100000:3.0:1788448390.417325:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902758912 00010000:00010000:3.0:1788448390.417350:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 10 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.417369:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759040 00000100:00100000:3.0:1788448390.417372:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759040 00010000:00010000:3.0:1788448390.417381:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 11 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448390.417395:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1788448390.417402:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+11:2352:x1875323902758912:12345-192.168.204.37@tcp:103: 00010000:00010000:3.0:1788448390.417413:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448390.417418:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 11 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417429:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 11 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417443:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247600/0xd0e9b344b90aae1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108bb expref: 11 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417455:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448390.417808:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902758912:12345-192.168.204.37@tcp:103: Request processed in 404us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.417816:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1788448390.417834:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1788448390.417841:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+9:2352:x1875323902759040:12345-192.168.204.37@tcp:103: 00010000:00010000:3.0:1788448390.417860:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448390.417866:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417876:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417888:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246800/0xd0e9b344b90aae17 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108b4 expref: 9 pid: 5830 timeout: 351 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417900:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417908:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417921:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417928:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417933:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417939:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417944:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448390.417948:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417966:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417981:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.417992:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448390.418012:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+8:2352:x1875323902759040:12345-192.168.204.37@tcp:103: Request processed in 172us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.418019:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00010000:00010000:3.0:1788448390.418044:0:8437:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.418052:0:8437:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448390.418058:0:8437:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8437 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448390.420837:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926899456:0@lo:103: 00000100:00100000:0.0:1788448390.424308:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926899200:0@lo:103: 00000100:00100000:0.0:1788448390.429251:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926899328:0@lo:103: 00000100:00100000:1.0:1788448390.430882:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:0.0:1788448390.696774:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448390.752425:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926899584:0@lo:13: 00000100:00100000:2.0:1788448390.752511:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448390.752570:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899584 00000100:00100000:3.0:1788448390.752579:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899584 00000100:00100000:3.0:1788448390.752658:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448390.752671:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926899584:12345-0@lo:13: 00002000:00000024:3.0:1788448390.752704:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448390.752764:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926899584:12345-0@lo:13: Request processed in 95us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448390.752772:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1788448390.752863:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c7480 x1875323926899584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448406 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448390.752884:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926899584:0@lo:13: 00000100:00080000:2.0:1788448390.753644:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448391.603889:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448391.603950:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448391.604103:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759296 00000100:00100000:2.0:1788448391.604114:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759296 00000100:00100000:2.0:1788448391.604235:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1788448391.604247:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902759296:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1788448391.604326:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902759296:12345-192.168.204.37@tcp:400: Request processed in 83us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.604334:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00080000:0.0:1788448391.604486:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448391.604666:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759168 00000100:00100000:3.0:1788448391.604680:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759168 00000100:00100000:3.0:1788448391.604727:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00100000:3.0:1788448391.604735:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:2352:x1875323902759168:12345-192.168.204.37@tcp:400: 00000100:00100000:3.0:1788448391.604776:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:2352:x1875323902759168:12345-192.168.204.37@tcp:400: Request processed in 42us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.604782:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00100000:0.0:1788448391.611991:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448391.612143:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759424 00000100:00100000:2.0:1788448391.612157:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759424 00000100:00100000:2.0:1788448391.612296:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448391.612308:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902759424:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1788448391.612417:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902759424:12345-192.168.204.37@tcp:400: Request processed in 110us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.612426:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:0.0:1788448391.612920:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448391.619351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448391.619918:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759552 00000100:00100000:2.0:1788448391.619931:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759552 00000100:00080000:0.0:1788448391.620304:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448391.620435:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448391.620449:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902759552:12345-192.168.204.37@tcp:400: 00000100:00100000:2.0:1788448391.620551:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902759552:12345-192.168.204.37@tcp:400: Request processed in 106us (1210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.620560:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00010000:00010000:1.0:1788448391.713474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788448391.840813:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788448391.840824:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80888c000 from 39 10000000:01000000:3.0:1788448391.840832:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448391.840902:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.840928:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.840943:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.840986:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899712:0@lo:101: 00000100:00100000:3.0:1788448391.841347:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.841485:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.851435:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899712 00000100:00100000:2.0:1788448391.851458:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899712 00000100:00100000:2.0:1788448391.851561:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788448391.851573:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+12:5834:x1875323926899712:12345-0@lo:101: 00010000:00010000:2.0:1788448391.851606:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448391.851635:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842179800/0xd0e9b344b90aae64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae5d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.851676:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179800/0xd0e9b344b90aae64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae5d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.851689:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842179800/0xd0e9b344b90aae64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae5d expref: 13 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.851700:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179800, rc 0) 00000100:00100000:2.0:1788448391.851821:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926899712:12345-0@lo:101: Request processed in 251us (10476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.851849:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1788448391.852699:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899712:0@lo:101: 00010000:00010000:0.0:1788448391.852732:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.852745:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448391.852852:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899840:0@lo:501: 00000100:00100000:0.0:1788448391.852904:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448391.852953:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.854820:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899840 00000100:00100000:2.0:1788448391.854841:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899840 00000100:00100000:2.0:1788448391.854953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788448391.854969:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926899840:12345-0@lo:501: 00000100:00100000:2.0:1788448391.855682:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926899840:12345-0@lo:501: Request processed in 710us (2771us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.855691:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1788448391.856004:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899840:0@lo:501: 00000100:00100000:0.0:1788448391.856086:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899968:0@lo:503: 00000100:00100000:0.0:1788448391.856147:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448391.856361:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.866746:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926899968 00000100:00100000:3.0:1788448391.866769:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926899968 00000100:00100000:3.0:1788448391.866879:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788448391.866892:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926899968:12345-0@lo:503: 00000100:00100000:3.0:1788448391.867528:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926899968:12345-0@lo:503: Request processed in 634us (11377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.867538:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788448391.867947:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926899968:0@lo:503: 00000100:00100000:2.0:1788448391.869997:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8455:1875323926900096:0@lo:502: 00000100:00100000:2.0:1788448391.870081:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.870135:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.870333:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900096 00000100:00100000:3.0:1788448391.870350:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900096 00000100:00100000:3.0:1788448391.870445:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788448391.870456:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:8455:x1875323926900096:12345-0@lo:502: 00000100:00100000:3.0:1788448391.870755:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:8455:x1875323926900096:12345-0@lo:502: Request processed in 301us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.870763:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788448391.870860:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8455:1875323926900096:0@lo:502: 00000100:00100000:1.0:1788448391.870922:0:8455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8455:1875323926900224:0@lo:502: 00000100:00100000:1.0:1788448391.870958:0:8455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.877347:0:8455:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.880142:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900224 00000100:00100000:2.0:1788448391.880158:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900224 00000100:00100000:1.0:1788448391.880410:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788448391.880420:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:8455:x1875323926900224:12345-0@lo:502: 00000100:00100000:1.0:1788448391.880742:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:8455:x1875323926900224:12345-0@lo:502: Request processed in 322us (9783us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.880759:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788448391.881061:0:8455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8455:1875323926900224:0@lo:502: 00000040:00080000:2.0:1788448391.881102:0:8455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1788448391.881394:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1788448391.881420:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448391.881430:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.881441:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448391.881450:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:1.0:1788448391.881453:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:1.0:1788448391.881456:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788448391.881489:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.881497:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.881516:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448391.881539:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900352:0@lo:101: 00000100:00100000:1.0:1788448391.881579:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.881616:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.881689:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900352 00000100:00100000:3.0:1788448391.881696:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900352 00000100:00100000:3.0:1788448391.881740:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448391.881748:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+13:5834:x1875323926900352:12345-0@lo:101: 00010000:00010000:3.0:1788448391.881758:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448391.881771:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae6b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.881792:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae6b expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.881802:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae6b expref: 14 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.881812:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246200, rc 0) 00000100:00100000:3.0:1788448391.881857:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900352:12345-0@lo:101: Request processed in 110us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.881863:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788448391.881944:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900352:0@lo:101: 00010000:00010000:1.0:1788448391.881957:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.881966:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448391.882020:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900480:0@lo:501: 00000100:00100000:1.0:1788448391.882046:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.882068:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.882316:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900480 00000100:00100000:3.0:1788448391.882321:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900480 00000100:00100000:3.0:1788448391.882341:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788448391.882347:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900480:12345-0@lo:501: 00000100:00100000:3.0:1788448391.882608:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900480:12345-0@lo:501: Request processed in 260us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.882622:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788448391.882704:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900480:0@lo:501: 00000100:00100000:1.0:1788448391.882734:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900608:0@lo:503: 00000100:00100000:1.0:1788448391.882772:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.882800:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.882881:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900608 00000100:00100000:2.0:1788448391.882885:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900608 00000100:00100000:2.0:1788448391.882905:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788448391.882912:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900608:12345-0@lo:503: 00000100:00100000:2.0:1788448391.883053:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900608:12345-0@lo:503: Request processed in 141us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.883060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788448391.883150:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900608:0@lo:503: 00000100:00100000:1.0:1788448391.883710:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8456:1875323926900736:0@lo:502: 00000100:00100000:1.0:1788448391.883751:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.883776:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.883839:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900736 00000100:00100000:2.0:1788448391.883844:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900736 00000100:00100000:2.0:1788448391.883881:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788448391.883888:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8456:x1875323926900736:12345-0@lo:502: 00000100:00100000:2.0:1788448391.884104:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8456:x1875323926900736:12345-0@lo:502: Request processed in 215us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.884111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788448391.884601:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8456:1875323926900736:0@lo:502: 00000020:01000000:1.0:1788448391.884632:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448391.884640:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448391.884643:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448391.884647:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788448391.884676:0:8456:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8456:1875323926900864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448391.884716:0:8456:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.884747:0:8456:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.884798:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900864 00000100:00100000:0.0:1788448391.884803:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900864 00000100:00100000:0.0:1788448391.884840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1788448391.884848:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8456:x1875323926900864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.885010:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:8456:x1875323926900864:12345-0@lo:502:llog_process_th.0 Request processed in 162us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.885023:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1788448391.885394:0:8456:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8456:1875323926900864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448391.885416:0:8456:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448391.885421:0:8456:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448391.885423:0:8456:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448391.885427:0:8456:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1788448391.885590:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788448391.885612:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788448391.885623:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.885634:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448391.885644:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788448391.885647:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a8092e0800 from 39 10000000:01000000:2.0:1788448391.885650:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788448391.885680:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.885687:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.885697:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448391.885712:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.885746:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.885779:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.885864:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926900992 00000100:00100000:0.0:1788448391.885870:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926900992 00000100:00100000:0.0:1788448391.885908:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788448391.885915:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:5834:x1875323926900992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448391.885924:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448391.885938:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092eda00/0xd0e9b344b90aae80 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae79 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.885957:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092eda00/0xd0e9b344b90aae80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae79 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.885966:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092eda00/0xd0e9b344b90aae80 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae79 expref: 15 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.885974:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eda00, rc 0) 00000100:00100000:0.0:1788448391.886010:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926900992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 95us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.886016:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788448391.886105:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926900992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448391.886118:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.886126:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448391.888578:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.888659:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.888696:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.888766:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901120 00000100:00100000:0.0:1788448391.888774:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901120 00000100:00100000:0.0:1788448391.888825:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788448391.888835:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926901120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448391.889119:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926901120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.889128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788448391.889312:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.889360:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.889400:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.889417:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.889431:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901248 00000100:00100000:1.0:1788448391.889434:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901248 00000100:00100000:1.0:1788448391.889457:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788448391.889464:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926901248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.890478:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926901248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1010us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.890488:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788448391.890788:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.891359:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8457:1875323926901376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.891419:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.891466:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.891521:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901376 00000100:00100000:1.0:1788448391.891527:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901376 00000100:00100000:1.0:1788448391.891567:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788448391.891576:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8457:x1875323926901376:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448391.891795:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8457:x1875323926901376:12345-0@lo:502:llog_process_th.0 Request processed in 219us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.891809:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448391.892001:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8457:1875323926901376:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.892051:0:8457:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8457:1875323926901504:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.892086:0:8457:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.892108:0:8457:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.892148:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901504 00000100:00100000:1.0:1788448391.892154:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901504 00000100:00100000:1.0:1788448391.892337:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788448391.892348:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8457:x1875323926901504:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448391.892698:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:8457:x1875323926901504:12345-0@lo:502:llog_process_th.0 Request processed in 351us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.892705:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788448391.893395:0:8457:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8457:1875323926901504:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788448391.893524:0:8457:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788448391.894560:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788448391.894591:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448391.894602:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.894613:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448391.894624:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1788448391.894626:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:3.0:1788448391.894629:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1788448391.894671:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.894679:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.894689:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.894714:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.894768:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.894802:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5bcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.894907:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901632 00000100:00100000:0.0:1788448391.894916:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901632 00000100:00100000:0.0:1788448391.894971:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788448391.894982:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:5834:x1875323926901632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448391.894997:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448391.895012:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ece00/0xd0e9b344b90aae8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae87 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.895035:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ece00/0xd0e9b344b90aae8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae87 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.895046:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ece00/0xd0e9b344b90aae8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae87 expref: 16 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.895054:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ece00, rc 0) 00000100:00100000:0.0:1788448391.895104:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926901632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.895111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788448391.895401:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448391.895417:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.895440:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.895493:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.895540:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.895571:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.895622:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901760 00000100:00100000:1.0:1788448391.895628:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901760 00000100:00100000:1.0:1788448391.895661:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788448391.895669:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926901760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.895938:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926901760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.895945:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1788448391.896111:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.896141:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.896230:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.896245:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.896340:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926901888 00000100:00100000:1.0:1788448391.896345:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926901888 00000100:00100000:1.0:1788448391.896377:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1788448391.896384:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926901888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.896555:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926901888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.896563:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788448391.896635:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afe680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926901888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448391.897235:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8458:1875323926902016:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.897279:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448391.897309:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872be40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.897391:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902016 00000100:00100000:1.0:1788448391.897397:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902016 00000100:00100000:1.0:1788448391.897435:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788448391.897443:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8458:x1875323926902016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448391.897629:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8458:x1875323926902016:12345-0@lo:502:llog_process_th.0 Request processed in 186us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.897636:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788448391.897851:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8458:1875323926902016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448391.897880:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448391.897890:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448391.897893:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448391.897898:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788448391.897921:0:8458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8458:1875323926902144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.897955:0:8458:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.897983:0:8458:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.898023:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902144 00000100:00100000:0.0:1788448391.898028:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902144 00000100:00100000:0.0:1788448391.898050:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788448391.898057:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8458:x1875323926902144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.898223:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:8458:x1875323926902144:12345-0@lo:502:llog_process_th.0 Request processed in 165us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.898237:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788448391.898322:0:8458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8458:1875323926902144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448391.898342:0:8458:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448391.898346:0:8458:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448391.898347:0:8458:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788448391.898351:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:0.0:1788448391.898642:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:0.0:1788448391.898661:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788448391.898670:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.898681:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448391.898691:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788448391.898694:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a80badd000 from 39 10000000:01000000:0.0:1788448391.898696:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788448391.898721:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.898728:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448391.898737:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448391.898751:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448391.898784:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448391.898814:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.898855:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902272 00000100:00100000:1.0:1788448391.898860:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902272 00000100:00100000:1.0:1788448391.898897:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788448391.898904:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926902272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448391.898913:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448391.898926:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810628000/0xd0e9b344b90aae9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aae95 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.898947:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810628000/0xd0e9b344b90aae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aae95 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.898956:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810628000/0xd0e9b344b90aae9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aae95 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.898965:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628000, rc 0) 00000100:00100000:1.0:1788448391.899002:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 98us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.899008:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788448391.899075:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448391.899087:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448391.899095:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448391.899152:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.899224:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.899246:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.899362:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902400 00000100:00100000:3.0:1788448391.899367:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902400 00000100:00100000:3.0:1788448391.899391:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788448391.899399:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.899678:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 279us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.899685:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1788448391.899820:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.899850:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.899886:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.899908:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeaf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.899972:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902528 00000100:00100000:1.0:1788448391.899976:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902528 00000100:00100000:1.0:1788448391.899997:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788448391.900006:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902528:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.900179:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902528:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.900217:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788448391.900446:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902528:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.900815:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8459:1875323926902656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.900857:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.900890:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.900930:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902656 00000100:00100000:0.0:1788448391.900935:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902656 00000100:00100000:0.0:1788448391.900972:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788448391.900979:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8459:x1875323926902656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.901163:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8459:x1875323926902656:12345-0@lo:502:llog_process_th.0 Request processed in 183us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.901212:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788448391.901372:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8459:1875323926902656:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.901415:0:8459:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8459:1875323926902784:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.901445:0:8459:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.901471:0:8459:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.901541:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902784 00000100:00100000:3.0:1788448391.901546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902784 00000100:00100000:3.0:1788448391.901579:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788448391.901587:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8459:x1875323926902784:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448391.901727:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8459:x1875323926902784:12345-0@lo:502:llog_process_th.0 Request processed in 140us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448391.901734:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788448391.901882:0:8459:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8459:1875323926902784:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788448391.901902:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1788448391.902134:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1788448391.902150:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788448391.902159:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.902180:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448391.902410:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1788448391.902413:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1788448391.902416:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1788448391.902444:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.902453:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.902462:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.902477:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902912:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.902580:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.902614:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.902661:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926902912 00000100:00100000:1.0:1788448391.902666:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926902912 00000100:00100000:1.0:1788448391.902701:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1788448391.902708:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926902912:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448391.902717:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448391.902729:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629600/0xd0e9b344b90aaeaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaea3 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.902750:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629600/0xd0e9b344b90aaeaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaea3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.902760:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629600/0xd0e9b344b90aaeaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaea3 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.902769:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629600, rc 0) 00000100:00100000:1.0:1788448391.902809:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926902912:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.902816:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788448391.902914:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926902912:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448391.902926:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.902934:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.902993:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.903017:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.903038:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.903084:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903040 00000100:00100000:0.0:1788448391.903088:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903040 00000100:00100000:0.0:1788448391.903120:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448391.903126:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926903040:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448391.903408:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926903040:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 281us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.903415:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788448391.903648:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903040:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.903676:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.903717:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.903745:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448391.903789:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903168 00000100:00100000:2.0:1788448391.903795:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903168 00000100:00100000:2.0:1788448391.903828:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788448391.903834:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926903168:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.903984:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926903168:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 149us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448391.903997:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448391.904072:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903168:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448391.905574:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8460:1875323926903296:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.905639:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.905671:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.905808:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903296 00000100:00100000:0.0:1788448391.905815:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903296 00000100:00100000:0.0:1788448391.905855:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788448391.905864:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8460:x1875323926903296:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.906089:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8460:x1875323926903296:12345-0@lo:502:llog_process_th.0 Request processed in 225us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.906097:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788448391.906664:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8460:1875323926903296:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448391.906699:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448391.906708:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448391.906710:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448391.906716:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788448391.906737:0:8460:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8460:1875323926903424:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448391.906775:0:8460:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448391.906808:0:8460:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448391.906920:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903424 00000100:00100000:0.0:1788448391.906925:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903424 00000100:00100000:0.0:1788448391.906987:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788448391.906995:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8460:x1875323926903424:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448391.907163:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8460:x1875323926903424:12345-0@lo:502:llog_process_th.0 Request processed in 167us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448391.907169:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788448391.907282:0:8460:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8460:1875323926903424:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448391.907302:0:8460:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448391.907307:0:8460:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448391.907308:0:8460:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788448391.907312:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1788448391.910455:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1788448391.910488:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788448391.910500:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.910530:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448391.910541:0:5834:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788448391.910544:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a8065799b8 from 1 10000000:01000000:3.0:1788448391.910546:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788448391.910586:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.910594:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.910606:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.910650:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903552:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.910719:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448391.916984:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903552 00000100:00100000:1.0:1788448391.917000:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903552 00000100:00100000:1.0:1788448391.917069:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788448391.917078:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926903552:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448391.917095:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448391.917112:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629200/0xd0e9b344b90aaeb8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaeb1 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.917139:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629200/0xd0e9b344b90aaeb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaeb1 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.917163:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629200/0xd0e9b344b90aaeb8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaeb1 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.917172:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629200, rc 0) 00000100:00100000:1.0:1788448391.917254:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926903552:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (6535us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448391.917260:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788448391.945494:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448391.945557:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903552:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448391.945585:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448391.945598:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448391.945681:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903680:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448391.945745:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448391.945779:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448391.945841:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903680 00000100:00100000:1.0:1788448391.945853:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903680 00000100:00100000:1.0:1788448391.945914:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448391.945925:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926903680:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448391.946260:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926903680:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 336us (514us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448391.946268:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788448391.946309:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926903680:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1788448391.946334:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1788448391.946341:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448391.946350:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448392.245168:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448392.245670:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759680 00000100:00100000:3.0:1788448392.245687:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759680 00000100:00100000:3.0:1788448392.246369:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:3.0:1788448392.246381:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+8:5593:x1875323902759680:12345-192.168.204.37@tcp:101: 00010000:00010000:3.0:1788448392.246404:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448392.246488:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aaebf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba051091d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.246540:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aaebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051091d expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.246552:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aaebf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051091d expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.246583:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246a00, rc 0) 00000100:00100000:3.0:1788448392.247084:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902759680:12345-192.168.204.37@tcp:101: Request processed in 703us (1924us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.247093:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:0.0:1788448392.252989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448392.253861:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759808 00000100:00100000:1.0:1788448392.253876:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759808 00000100:00100000:1.0:1788448392.254007:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:1.0:1788448392.254039:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902759808:12345-192.168.204.37@tcp:501: 00000100:00100000:1.0:1788448392.255129:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902759808:12345-192.168.204.37@tcp:501: Request processed in 1085us (2148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.255141:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:0.0:1788448392.268590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448392.268901:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902759936 00000100:00100000:3.0:1788448392.268915:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902759936 00000100:00100000:3.0:1788448392.269000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:3.0:1788448392.269013:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902759936:12345-192.168.204.37@tcp:503: 00000100:00100000:3.0:1788448392.269369:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902759936:12345-192.168.204.37@tcp:503: Request processed in 356us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.269378:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:2.0:1788448392.275610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448392.285547:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760064 00000100:00100000:1.0:1788448392.285571:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760064 00000100:00100000:1.0:1788448392.285700:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:1.0:1788448392.285716:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:6064:x1875323902760064:12345-192.168.204.37@tcp:502: 00000100:00100000:1.0:1788448392.286140:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:6064:x1875323902760064:12345-192.168.204.37@tcp:502: Request processed in 426us (10548us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.286149:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:0.0:1788448392.292945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448392.293745:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760192 00000100:00100000:1.0:1788448392.293763:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760192 00000100:00100000:1.0:1788448392.293848:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:1.0:1788448392.293859:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+9:6064:x1875323902760192:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448392.294294:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+9:6064:x1875323902760192:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 433us (1365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.294304:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:0.0:1788448392.300174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448392.300356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760320 00000100:00100000:3.0:1788448392.300371:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760320 00000100:00100000:3.0:1788448392.300461:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:3.0:1788448392.300479:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902760320:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448392.300511:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448392.300535:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247000/0xd0e9b344b90aaec6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510924 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.300576:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247000/0xd0e9b344b90aaec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510924 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.300596:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247000/0xd0e9b344b90aaec6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510924 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448392.300607:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247000, rc 0) 00000100:00100000:3.0:1788448392.300703:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760320:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 227us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448392.300712:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:2.0:1788448392.305947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448392.306068:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760448 00000100:00100000:0.0:1788448392.306081:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760448 00000100:00100000:0.0:1788448392.306168:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 169 00000100:00100000:0.0:1788448392.306182:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760448:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448392.308005:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760448:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 1809us (2056us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448392.308023:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 169 00010000:00010000:0.0:1788448392.736477:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448392.802104:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926904192:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.802255:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.802387:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788448392.802395:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926903808:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.802433:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.802457:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926904320:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.802526:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.802571:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904320 00000100:00100000:2.0:1788448392.802583:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904320 00000100:00100000:2.0:1788448392.802661:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448392.802687:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926904320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.802754:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926904320:12345-0@lo:400:kworker.0 Request processed in 70us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.802762:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788448392.802824:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926904320:0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.803392:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904192 00000100:00100000:1.0:1788448392.803401:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904192 00000100:00100000:0.0:1788448392.803535:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926903936:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.803577:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448392.803607:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926904448:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.803629:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.806031:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903936 00000100:00100000:2.0:1788448392.806055:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903936 00000100:00100000:2.0:1788448392.806162:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448392.806178:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926903936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.806331:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926903936:12345-0@lo:400:kworker.0 Request processed in 158us (2753us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.806340:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1788448392.806396:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448392.806403:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448392.806436:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926904064:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.806482:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448392.806560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904064 00000100:00100000:2.0:1788448392.806566:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904064 00000100:00100000:2.0:1788448392.806617:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448392.806625:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926904064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.806665:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926904064:12345-0@lo:400:kworker.0 Request processed in 40us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.806695:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1788448392.806715:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448392.806751:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926904064:0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.806796:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926903808 00000100:00100000:2.0:1788448392.806800:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926903808 00000100:00100000:2.0:1788448392.806832:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788448392.806840:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926903808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448392.806884:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926903808:12345-0@lo:400:kworker.0 Request processed in 45us (4450us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448392.806891:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788448392.806926:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926903808:0@lo:400:kworker.0 00000100:00100000:0.0:1788448392.813084:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926903936:0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.820509:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904448 00000100:00100000:1.0:1788448392.820534:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904448 00000100:00080000:2.0:1788448392.820927:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448392.821048:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448392.821065:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926904192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.821245:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926904192:12345-0@lo:400:kworker.0 Request processed in 185us (18989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.821278:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448392.821317:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448392.821324:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926904448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448392.821578:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926904448:12345-0@lo:400:kworker.0 Request processed in 254us (17947us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448392.821586:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788448392.821881:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c7100 x1875323926904448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448392.821900:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926904448:0@lo:400:kworker.0 00010000:00080000:2.0:1788448392.822025:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c7480 x1875323926904192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448408 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448392.822037:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926904192:0@lo:400:kworker.0 00000100:00100000:2.0:1788448393.312554:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926904576:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448393.312640:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448393.312718:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904576 00000100:00100000:2.0:1788448393.312738:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904576 00000100:00100000:2.0:1788448393.312785:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788448393.313108:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926904576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448393.313146:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448393.313442:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926904576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 647us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448393.313459:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1788448393.313516:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e4700 x1875323926904576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448393.313535:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926904576:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788448393.575060:0:8497:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc0782870 20000000:00000080:0.0:1788448393.575078:0:8497:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a83cdca800 uarg=0000000000000000 20000000:01000000:0.0:1788448393.575117:0:8497:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448393.575123:0:8497:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448393.575128:0:8497:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788448393.576804:0:8498:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788448393.576929:0:8497:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788448393.584424:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788448393.584564:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788448393.584624:0:8497:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788448393.584641:0:8497:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788448393.584661:0:8497:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584679:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584687:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584694:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584705:0:8497:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584712:0:8497:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584755:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584785:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 9 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.584801:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904704:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448393.584963:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.584972:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 18 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.584982:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904832:0@lo:104: 00000100:00100000:2.0:1788448393.585024:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448393.585087:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.585097:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 18 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.585105:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904960:0@lo:104: 00000100:00100000:2.0:1788448393.585129:0:8497:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448393.585163:0:8497:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.585171:0:8497:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 18 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.585179:0:8497:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926905088:0@lo:104: 00000100:00100000:2.0:1788448393.585219:0:8497:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448393.585380:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788448393.585399:0:5821:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448393.585415:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904832 00000100:00100000:3.0:1788448393.585422:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904832 00000100:00100000:3.0:1788448393.585724:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926904960 00000100:00100000:3.0:1788448393.585729:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926904960 00000100:00100000:3.0:1788448393.585742:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905088 00000100:00100000:3.0:1788448393.585744:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905088 00000100:00100000:3.0:1788448393.585757:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448393.585765:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:8497:x1875323926904832:12345-0@lo:104: 00010000:00010000:3.0:1788448393.585778:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448393.585947:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448393.585953:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:8497:x1875323926904832:12345-0@lo:104: Request processed in 189us (929us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.585960:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448393.585978:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788448393.585983:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70458d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:8497:x1875323926904960:12345-0@lo:104: 00010000:00010000:3.0:1788448393.585991:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448393.586025:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788448393.586029:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70458d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:8497:x1875323926904960:12345-0@lo:104: Request processed in 47us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.586046:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788448393.586093:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788448393.586100:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:8497:x1875323926905088:12345-0@lo:104: 00010000:00010000:3.0:1788448393.586107:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448393.586132:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788448393.586136:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:8497:x1875323926905088:12345-0@lo:104: Request processed in 38us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448393.586141:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788448393.586202:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788448393.586210:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586217:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448393.586221:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586229:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448393.586236:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448393.586242:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448393.586277:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586284:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448393.586313:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586319:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629400/0xd0e9b344b90aad68 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aad6f expref: -99 pid: 7621 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586333:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448393.586336:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586341:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448393.586344:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586351:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448393.586358:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448393.586363:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448393.586376:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586383:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448393.586388:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586394:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a800031000/0xd0e9b344b90aac9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaca4 expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586404:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448393.586412:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586418:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448393.586421:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586427:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448393.586433:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448393.586438:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788448393.586464:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586469:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788448393.586493:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586499:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90aac3b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aac42 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586512:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448393.586514:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448393.586515:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448393.586529:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926905216:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448393.586560:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448393.586589:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448393.586595:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926905344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448393.586620:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448393.586642:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926905472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448393.586661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448393.586689:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905216 00000100:00100000:1.0:1788448393.586694:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905216 00010000:00010000:1.0:1788448393.586714:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 19 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448393.586731:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905344 00000100:00100000:1.0:1788448393.586734:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905344 00010000:00010000:1.0:1788448393.586742:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 20 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448393.586750:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905472 00000100:00100000:1.0:1788448393.586752:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905472 00010000:00010000:1.0:1788448393.586760:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 21 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448393.586770:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448393.586775:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+21:3309:x1875323926905216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448393.586785:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448393.586789:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 21 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586797:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 21 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586813:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448393.586836:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+21:3309:x1875323926905216:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448393.586850:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448393.586863:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448393.586868:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3309:x1875323926905344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448393.586875:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448393.586879:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 20 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586886:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 20 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586894:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448393.586914:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3309:x1875323926905344:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448393.586920:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788448393.586931:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448393.586936:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926905472:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448393.586943:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448393.586947:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 19 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586954:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 19 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448393.586962:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448393.586984:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926905472:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448393.586990:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1788448393.587022:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448393.587025:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926905472:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448393.587058:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926905344:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448393.587065:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926905216:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448393.591798:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aad6f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aad68 expref: 18 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.591822:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904832:0@lo:104: 00010000:00010000:2.0:1788448393.591837:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178000/0xd0e9b344b90aaca4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aac9d expref: 17 pid: 5829 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.591846:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904960:0@lo:104: 00010000:00010000:2.0:1788448393.591856:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800031200/0xd0e9b344b90aac42 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aac3b expref: 16 pid: 5830 timeout: 404 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.591866:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926905088:0@lo:104: 00000100:00100000:0.0:1788448393.592645:0:8497:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8497:1875323926904704:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448393.592690:0:8497:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448393.594218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448393.594364:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760576 00000100:00100000:2.0:1788448393.594375:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760576 00010000:00010000:2.0:1788448393.594417:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.594455:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1788448393.594466:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902760576:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448393.594489:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448393.594495:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594506:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594523:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90aae2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108ec expref: 10 pid: 5830 timeout: 354 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594558:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594566:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594582:0:6696:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594589:0:6696:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594596:0:6696:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594602:0:6696:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594609:0:6696:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448393.594613:0:6696:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594622:0:6696:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594641:0:6696:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448393.594652:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448393.594684:0:8497:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448393.594705:0:8497:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.594713:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:188c2354-2939-43ce-85d0-cb78875d8855+9:2352:x1875323902760576:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 247us (530us total) trans 0 rc 0/0 00010000:00010000:0.0:1788448393.594716:0:8497:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842179e00/0xd0e9b344b90aaecd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8497 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448393.594730:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00010000:00010000:2.0:1788448393.761716:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448394.785540:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448395.173750:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788448395.173756:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80888c000 from 4 10000000:01000000:1.0:1788448395.173761:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788448395.173804:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.173816:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.173826:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448395.173849:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905600:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.173915:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448395.174007:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.174049:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905600 00000100:00100000:3.0:1788448395.174057:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905600 00000100:00100000:3.0:1788448395.174136:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788448395.174146:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926905600:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448395.174158:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448395.174171:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaed4 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.174271:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.174282:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.174291:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247800, rc 0) 00000100:00100000:3.0:1788448395.174329:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926905600:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 185us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.174336:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788448395.174673:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905600:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448395.174705:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.174715:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448395.174780:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.174809:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.174866:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a829734d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.174899:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905728 00000100:00100000:1.0:1788448395.174904:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905728 00000100:00100000:1.0:1788448395.174963:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788448395.174971:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926905728:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.175327:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926905728:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 356us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.175335:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788448395.175425:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905728:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.175471:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.175520:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.175542:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905856 00000100:00100000:3.0:1788448395.175547:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905856 00000100:00100000:3.0:1788448395.175570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788448395.175578:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926905856:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.176036:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926905856:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 458us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.176045:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788448395.176079:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a829734d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.176092:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926905856:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.176336:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8555:1875323926905984:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.176371:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.176510:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926905984 00000100:00100000:3.0:1788448395.176516:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926905984 00000100:00100000:3.0:1788448395.176547:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788448395.176553:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8555:x1875323926905984:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.176683:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8555:x1875323926905984:12345-0@lo:502:llog_process_th.0 Request processed in 129us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.176689:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1788448395.176718:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.176729:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8555:1875323926905984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.176749:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448395.176759:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.176762:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448395.176769:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a80888c000 00000020:00000080:3.0:1788448395.176772:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448395.178153:0:8555:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8555:1875323926906112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.178478:0:8555:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.178517:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906112 00000100:00100000:3.0:1788448395.178525:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906112 00000100:00100000:3.0:1788448395.178575:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788448395.178585:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8555:x1875323926906112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.178855:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:8555:x1875323926906112:12345-0@lo:502:llog_process_th.0 Request processed in 271us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.178864:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788448395.178916:0:8555:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.178936:0:8555:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8555:1875323926906112:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.178970:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448395.178978:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.178980:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788448395.178985:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788448395.179048:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788448395.179069:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448395.179079:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.179091:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448395.179102:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448395.179106:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a8092e0800 from 4 10000000:01000000:3.0:1788448395.179109:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448395.179139:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.179146:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.179322:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448395.179342:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.179456:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.179525:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.179851:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906240 00000100:00100000:1.0:1788448395.179858:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906240 00000100:00100000:1.0:1788448395.179942:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788448395.179953:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926906240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448395.179964:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448395.179979:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaee2 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.180004:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.180013:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.180022:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:1.0:1788448395.180062:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.180068:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788448395.180126:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448395.180139:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.180147:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448395.180310:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.180338:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.180355:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.180735:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906368 00000100:00100000:1.0:1788448395.180742:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906368 00000100:00100000:1.0:1788448395.180814:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788448395.180824:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.181107:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 283us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.181115:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788448395.181174:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.181308:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.181347:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.181362:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.181456:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906496 00000100:00100000:3.0:1788448395.181461:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906496 00000100:00100000:3.0:1788448395.181486:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448395.181494:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.181638:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 144us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.181644:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1788448395.181679:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.181838:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8556:1875323926906624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.181871:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.181891:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906624 00000100:00100000:3.0:1788448395.181894:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906624 00000100:00100000:3.0:1788448395.181911:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788448395.181917:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8556:x1875323926906624:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.182028:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8556:x1875323926906624:12345-0@lo:502:llog_process_th.0 Request processed in 110us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.182044:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1788448395.182076:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.182088:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8556:1875323926906624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.182107:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448395.182115:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.182117:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448395.182124:0:8556:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a8092e0800 00000020:00000080:3.0:1788448395.182127:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448395.183295:0:8556:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8556:1875323926906752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.183349:0:8556:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.183465:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906752 00000100:00100000:3.0:1788448395.183471:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906752 00000100:00100000:3.0:1788448395.183518:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788448395.183527:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8556:x1875323926906752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.183703:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:8556:x1875323926906752:12345-0@lo:502:llog_process_th.0 Request processed in 176us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.183711:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788448395.183756:0:8556:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448395.183773:0:8556:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8556:1875323926906752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.183797:0:8556:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448395.183803:0:8556:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.183805:0:8556:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788448395.183809:0:8556:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788448395.183864:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788448395.183882:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448395.183891:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.183909:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448395.183920:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448395.183923:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80badd000 from 4 10000000:01000000:3.0:1788448395.183925:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448395.183954:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.183961:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448395.183970:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448395.183983:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.184010:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.184024:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.184281:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926906880 00000100:00100000:1.0:1788448395.184286:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926906880 00000100:00100000:1.0:1788448395.184315:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788448395.184323:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926906880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448395.184333:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448395.184353:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaef0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.184704:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.184719:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.184728:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628600, rc 0) 00000100:00100000:1.0:1788448395.184775:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926906880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 452us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.184784:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1788448395.184845:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926906880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448395.184859:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.184868:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448395.184926:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926907008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.184952:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448395.184973:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.184985:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907008 00000100:00100000:1.0:1788448395.184989:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907008 00000100:00100000:1.0:1788448395.185011:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1788448395.185017:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926907008:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.185745:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926907008:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 725us (790us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.185760:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788448395.188024:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926907008:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.188088:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926907136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.188155:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.188383:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.191313:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907136 00000100:00100000:1.0:1788448395.191328:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907136 00000100:00100000:1.0:1788448395.191464:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788448395.191476:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926907136:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448395.191917:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926907136:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 442us (3760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.191926:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788448395.192014:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926907136:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.192875:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8559:1875323926907264:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.192939:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.193012:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.193059:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907264 00000100:00100000:1.0:1788448395.193066:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907264 00000100:00100000:1.0:1788448395.193142:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1788448395.193152:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:8559:x1875323926907264:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448395.193541:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:8559:x1875323926907264:12345-0@lo:502:llog_process_th.0 Request processed in 389us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.193548:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1788448395.193641:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8559:1875323926907264:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.193667:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448395.193677:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.193679:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788448395.193687:0:8559:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a80badd000 00000020:00000080:3.0:1788448395.193689:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788448395.193781:0:8559:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8559:1875323926907392:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448395.193818:0:8559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.193833:0:8559:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448395.194122:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907392 00000100:00100000:1.0:1788448395.194128:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907392 00000100:00100000:1.0:1788448395.194273:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1788448395.194283:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:8559:x1875323926907392:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448395.194463:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:8559:x1875323926907392:12345-0@lo:502:llog_process_th.0 Request processed in 182us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448395.194469:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788448395.194837:0:8559:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:8559:1875323926907392:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448395.194859:0:8559:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448395.194867:0:8559:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448395.194869:0:8559:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788448395.194874:0:8559:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1788448395.195024:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1788448395.195046:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448395.195056:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448395.195079:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448395.582802:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448395.584075:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760704 00000100:00100000:0.0:1788448395.584089:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760704 00000100:00100000:0.0:1788448395.584146:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 186 00000100:00100000:0.0:1788448395.584157:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+9:5593:x1875323902760704:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448395.584175:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448395.584221:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba051092b expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448395.584251:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448395.584262:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 10 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448395.584270:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed800, rc 0) 00000100:00100000:0.0:1788448395.584331:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760704:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 176us (1538us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448395.584337:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 186 00000100:00100000:1.0:1788448395.597378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448395.597474:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760832 00000100:00100000:3.0:1788448395.597484:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760832 00000100:00100000:3.0:1788448395.597542:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 187 00000100:00100000:3.0:1788448395.597553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760832:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.597817:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760832:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 265us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.597825:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 187 00000100:00100000:1.0:1788448395.603856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448395.603991:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902760960 00000100:00100000:3.0:1788448395.604001:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902760960 00000100:00100000:3.0:1788448395.604059:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:3.0:1788448395.604070:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760960:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448395.604463:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:5593:x1875323902760960:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 393us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.604478:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:3.0:1788448395.619597:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448395.619844:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761088 00000100:00100000:1.0:1788448395.619858:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761088 00000100:00100000:0.0:1788448395.619952:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:0.0:1788448395.619963:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:6128:x1875323902761088:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448395.621172:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:6128:x1875323902761088:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 1204us (1579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448395.621211:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:3.0:1788448395.625001:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448395.626608:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761216 00000100:00100000:0.0:1788448395.626625:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761216 00000100:00100000:0.0:1788448395.626734:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:0.0:1788448395.626746:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:6128:x1875323902761216:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448395.627026:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:6128:x1875323902761216:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 280us (2032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448395.627034:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 190 00010000:00010000:3.0:1788448395.810468:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448395.875768:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926907520:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448395.875844:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448395.877529:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907520 00000100:00100000:3.0:1788448395.877546:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907520 00000100:00100000:3.0:1788448395.877623:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448395.877635:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926907520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448395.877678:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1788448395.881390:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448395.885218:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926907520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 7548us (9337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448395.885236:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788448395.889707:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807975180 x1875323926907520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448411 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448395.889741:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926907520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448396.723847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448396.723953:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448396.723989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448396.724056:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448396.724120:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761472 00000100:00100000:2.0:1788448396.724130:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761472 00000100:00100000:2.0:1788448396.724245:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1788448396.724258:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902761472:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448396.726034:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761344 00000100:00100000:0.0:1788448396.726048:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761344 00000100:00100000:0.0:1788448396.726108:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 191 00000100:00100000:0.0:1788448396.726117:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902761344:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448396.726521:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902761472:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 2263us (2528us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448396.726690:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00080000:2.0:1788448396.726728:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448396.727779:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902761344:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 1654us (3936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448396.727790:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 191 00000100:00100000:2.0:1788448396.730510:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761728 00000100:00100000:1.0:1788448396.730510:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761600 00000100:00100000:1.0:1788448396.730527:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761600 00000100:00100000:2.0:1788448396.730535:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761728 00000100:00100000:1.0:1788448396.730636:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1788448396.730645:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448396.730650:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902761600:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448396.730661:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902761728:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448396.730740:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902761600:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 94us (6785us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448396.730748:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00080000:3.0:1788448396.730767:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448396.730774:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448396.731439:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902761728:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 781us (7381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448396.731447:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00010000:00010000:0.0:1788448396.832391:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448397.856684:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448397.920762:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926907776:0@lo:400:kworker.0 00000100:00100000:2.0:1788448397.920801:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926907904:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.920840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448397.920877:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907776 00000100:00100000:2.0:1788448397.920885:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907776 00000100:00100000:2.0:1788448397.921030:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448397.921040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926907776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921180:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926908288:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921229:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448397.921256:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788448397.921272:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926907648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921303:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448397.921324:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926908160:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921353:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448397.921384:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908032:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921423:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448397.921453:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908288 00000100:00100000:1.0:1788448397.921457:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908288 00000100:00100000:1.0:1788448397.921511:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908032 00000100:00100000:1.0:1788448397.921515:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908032 00000100:00100000:1.0:1788448397.921537:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448397.921544:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926908288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921586:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926908288:12345-0@lo:400:kworker.0 Request processed in 41us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448397.921593:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448397.921612:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448397.921619:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921652:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908032:12345-0@lo:400:kworker.0 Request processed in 34us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448397.921658:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448397.921675:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908160 00000100:00100000:1.0:1788448397.921679:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908160 00000100:00100000:1.0:1788448397.921704:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448397.921712:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926908160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.921742:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926908160:12345-0@lo:400:kworker.0 Request processed in 32us (389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448397.922143:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448397.922167:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926907776:12345-0@lo:400:kworker.0 Request processed in 1126us (1326us total) trans 0 rc 0/0 00000100:00080000:1.0:1788448397.922172:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448397.922177:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448397.922180:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448397.922208:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788448397.922223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788448397.922280:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9f100 x1875323926908032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448397.922284:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907648 00000100:00100000:0.0:1788448397.922292:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907648 00000100:00100000:1.0:1788448397.922299:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908032:0@lo:400:kworker.0 00000100:00100000:0.0:1788448397.922340:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1788448397.922353:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926907648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448397.922471:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926907648:12345-0@lo:400:kworker.0 Request processed in 124us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448397.922478:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1788448397.922584:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926907904 00000100:00100000:1.0:1788448397.922589:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926907904 00000100:00080000:2.0:1788448397.922620:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448397.922634:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788448397.922642:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926907904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.922685:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926907904:12345-0@lo:400:kworker.0 Request processed in 44us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448397.922692:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448397.923413:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926907904:0@lo:400:kworker.0 00000100:00100000:0.0:1788448397.923753:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926907648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.924323:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926908160:0@lo:400:kworker.0 00000100:00100000:1.0:1788448397.924338:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926907776:0@lo:400:kworker.0 00010000:00080000:1.0:1788448397.924354:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9c000 x1875323926908288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448413 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448397.924436:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926908288:0@lo:400:kworker.0 00000100:00100000:1.0:1788448398.432517:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448398.432540:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448398.432612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448398.432688:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908416 00000100:00100000:1.0:1788448398.432696:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908416 00000100:00100000:1.0:1788448398.432748:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448398.432757:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448398.432807:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448398.432852:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448398.432860:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1788448398.432903:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9c000 x1875323926908416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448398.432922:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908416:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788448398.880327:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448399.911104:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448400.289955:0:8797:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788448400.931954:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448400.995992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448400.996068:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448400.996236:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908544 00000100:00100000:2.0:1788448400.996244:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908544 00000100:00100000:2.0:1788448400.996297:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448400.996307:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448400.996356:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448400.996400:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926908544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448400.996406:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1788448400.996997:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448400.997036:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807976a00 x1875323926908544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448416 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448400.997059:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926908544:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448401.847740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448401.847860:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448401.847933:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448401.847990:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448401.848041:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761984 00000100:00100000:3.0:1788448401.848051:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761984 00000100:00100000:3.0:1788448401.848117:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1788448401.848130:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902761984:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448401.849253:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902761984:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 1119us (1312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448401.849282:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:0.0:1788448401.849487:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902761856 00000100:00100000:0.0:1788448401.849494:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902761856 00000100:00100000:0.0:1788448401.849531:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:0.0:1788448401.849539:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2354:x1875323902761856:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448401.849579:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2354:x1875323902761856:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 41us (1853us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448401.849585:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:2.0:1788448401.850015:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762112 00000100:00100000:2.0:1788448401.850021:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762112 00000100:00100000:2.0:1788448401.850110:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762240 00000100:00100000:2.0:1788448401.850114:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762240 00000100:00100000:2.0:1788448401.850134:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:2.0:1788448401.850141:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902762112:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448401.850180:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902762112:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 40us (2321us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448401.850204:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:2.0:1788448401.850220:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:2.0:1788448401.850229:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902762240:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448401.850256:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902762240:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 29us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448401.850287:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00080000:2.0:1788448401.851260:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448401.851487:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448401.851491:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448401.953391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448402.977501:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448403.041475:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926908800:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041552:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041668:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926909312:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041696:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041729:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448403.041735:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926908672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041762:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041783:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926909184:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041802:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041828:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926909056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041850:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041865:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448403.041870:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926908928:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.041887:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448403.041915:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908800 00000100:00100000:2.0:1788448403.041922:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908800 00000100:00100000:2.0:1788448403.041966:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909184 00000100:00100000:2.0:1788448403.041969:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909184 00000100:00100000:2.0:1788448403.041988:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908928 00000100:00100000:2.0:1788448403.041990:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908928 00000100:00100000:2.0:1788448403.042005:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448403.042012:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926908800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.042073:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926908800:12345-0@lo:400:kworker.0 Request processed in 62us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.042081:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448403.042097:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448403.042103:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926909184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.042127:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926909184:12345-0@lo:400:kworker.0 Request processed in 25us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.042132:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448403.042143:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448403.042148:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926908928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.042769:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926908928:12345-0@lo:400:kworker.0 Request processed in 617us (876us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.042777:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448403.042801:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909312 00000100:00100000:2.0:1788448403.042805:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909312 00000100:00100000:2.0:1788448403.042840:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909056 00000100:00100000:2.0:1788448403.042843:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909056 00000100:00100000:2.0:1788448403.042859:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448403.042866:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926909312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.042897:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926909312:12345-0@lo:400:kworker.0 Request processed in 32us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.042903:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448403.042914:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448403.042919:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926909056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.042945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926909056:12345-0@lo:400:kworker.0 Request processed in 26us (1094us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448403.042964:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1788448403.042987:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448403.042991:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448403.042993:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448403.043029:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926909184:0@lo:400:kworker.0 00000100:00100000:2.0:1788448403.043042:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926908800:0@lo:400:kworker.0 00000100:00100000:3.0:1788448403.043053:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926908928:0@lo:400:kworker.0 00010000:00080000:2.0:1788448403.043056:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a834875f80 x1875323926909312/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:3.0:1788448403.043064:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807975c00 x1875323926909056/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448403.043066:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834875f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926909312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448403.043073:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926909056:0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.047371:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926908672 00000100:00100000:1.0:1788448403.047386:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926908672 00000100:00100000:1.0:1788448403.047466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788448403.047478:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926908672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.047578:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926908672:12345-0@lo:400:kworker.0 Request processed in 101us (5813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.047586:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1788448403.047662:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807976a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926908672:0@lo:400:kworker.0 00000100:00100000:1.0:1788448403.558469:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926909440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448403.558540:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448403.558615:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909440 00000100:00100000:1.0:1788448403.558623:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909440 00000100:00100000:1.0:1788448403.558672:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788448403.558682:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926909440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448403.558717:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448403.558764:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926909440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448403.558771:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788448403.558808:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9c700 x1875323926909440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448403.558827:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926909440:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448404.007132:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448405.025024:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448405.601460:0:9041:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing yml_node 00010000:00010000:2.0:1788448406.050026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448406.112476:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926909568:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448406.112551:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448406.112758:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909568 00000100:00100000:1.0:1788448406.112767:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909568 00000100:00100000:1.0:1788448406.112833:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788448406.112843:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926909568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448406.112878:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448406.112922:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926909568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448406.112929:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:1.0:1788448406.112969:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448406.113439:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9c700 x1875323926909568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448422 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448406.113459:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926909568:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448406.983274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448406.983432:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762368 00000100:00100000:2.0:1788448406.983443:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762368 00000100:00100000:2.0:1788448406.983495:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:2.0:1788448406.983506:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902762368:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448406.983589:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902762368:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 84us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.983597:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:0.0:1788448406.984240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448406.984406:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762496 00000100:00100000:3.0:1788448406.984412:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762496 00000100:00100000:3.0:1788448406.984480:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:3.0:1788448406.984490:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902762496:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448406.984537:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902762496:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 49us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448406.984545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00080000:2.0:1788448406.984605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448406.987578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448406.987637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448406.987742:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762624 00000100:00100000:2.0:1788448406.987751:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762624 00000100:00100000:2.0:1788448406.987828:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762752 00000100:00100000:2.0:1788448406.987832:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762752 00000100:00100000:2.0:1788448406.987852:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1788448406.987862:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2351:x1875323902762624:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:2.0:1788448406.987928:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aae3a 00000100:00080000:2.0:1788448406.987940:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a704f1c000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448406.987981:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788448406.988446:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+2:2351:x1875323902762624:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 583us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.988454:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:2.0:1788448406.988472:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448406.988480:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2351:x1875323902762752:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:2.0:1788448406.988494:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aae41 00000100:00080000:2.0:1788448406.988499:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a704f1f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448406.988520:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1788448406.988709:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+2:2351:x1875323902762752:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 230us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448406.988715:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00010000:00010000:2.0:1788448406.988735:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448406.988742:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448406.989567:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448406.989574:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448407.072446:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448408.098504:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448408.161434:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926910080:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.161651:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926909824:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.161701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448408.161763:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926910336:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.161788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.161867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926909952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.161901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448408.161952:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909824 00000100:00100000:2.0:1788448408.161960:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909824 00000100:00100000:2.0:1788448408.162000:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909952 00000100:00100000:2.0:1788448408.162003:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909952 00000100:00100000:2.0:1788448408.162032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448408.162039:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926909824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.162087:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926909824:12345-0@lo:400:kworker.0 Request processed in 47us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.162100:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448408.162117:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448408.162123:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926909952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.162167:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926909952:12345-0@lo:400:kworker.0 Request processed in 45us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448408.162173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:2.0:1788448408.162220:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448408.162251:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926909952:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.162964:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926909824:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.162977:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788448408.162984:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926909696:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.163018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448408.163054:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926910208:0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.163078:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448408.163107:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926909696 00000100:00100000:1.0:1788448408.163112:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926909696 00000100:00100000:1.0:1788448408.163146:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788448408.163154:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926909696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.163221:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926909696:12345-0@lo:400:kworker.0 Request processed in 67us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.163228:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1788448408.163262:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926909696:0@lo:400:kworker.0 00000100:00100000:3.0:1788448408.164230:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448408.164590:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910336 00000100:00100000:1.0:1788448408.164598:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910336 00000100:00100000:1.0:1788448408.164659:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910080 00000100:00100000:1.0:1788448408.164662:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910080 00000100:00100000:1.0:1788448408.164679:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448408.164687:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926910336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.164744:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926910336:12345-0@lo:400:kworker.0 Request processed in 58us (2956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.164766:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448408.164780:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788448408.165920:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926910080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448408.165994:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926910080:12345-0@lo:400:kworker.0 Request processed in 1205us (1765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448408.166002:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1788448408.166063:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835affb80 x1875323926910336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448408.166078:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835affb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926910336:0@lo:400:kworker.0 00000100:00080000:3.0:1788448408.166176:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448408.166181:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788448408.166242:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835afc000 x1875323926910080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448408.166253:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926910080:0@lo:400:kworker.0 00000100:00100000:0.0:1788448408.167839:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910208 00000100:00100000:0.0:1788448408.167851:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910208 00000100:00100000:0.0:1788448408.167928:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448408.167938:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926910208:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788448408.168012:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448408.168015:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926910208:12345-0@lo:400:kworker.0 Request processed in 79us (4936us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.168024:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448408.168081:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926910208:0@lo:400:kworker.0 00000100:00100000:2.0:1788448408.672473:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926910464:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448408.672548:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448408.673233:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910464 00000100:00100000:0.0:1788448408.673243:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910464 00000100:00100000:0.0:1788448408.673302:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788448408.673312:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926910464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448408.673350:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448408.673411:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926910464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448408.673419:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1788448408.673581:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9d180 x1875323926910464/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448408.673612:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926910464:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448409.121018:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448409.276651:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:3.0:1788448409.276661:0:6707:0:(genops.c:885:class_export_put()) final put ffff99a704f18800/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:2.0:1788448409.276894:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704f18800/af250c24-64ec-487b-a1ec-11a62017775a for lustre-OST0000 00000020:00000080:2.0:1788448409.276945:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a704f1c000 for lustre-OST0000 00010000:00010000:1.0:1788448410.145526:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448410.599783:0:9235:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.103 00010000:00010000:2.0:1788448411.171884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448411.235288:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448411.235322:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926910592:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448411.235426:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448411.235926:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910592 00000100:00100000:1.0:1788448411.235937:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910592 00000100:00100000:1.0:1788448411.238362:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448411.238384:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926910592:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448411.238442:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448411.238571:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926910592:12345-0@lo:13:osp-pre-0-0.0 Request processed in 194us (3145us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448411.238580:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1788448411.238648:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a706c9ce00 x1875323926910592/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448427 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448411.238678:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926910592:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448411.240792:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788448411.296571:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:1.0:1788448411.296587:0:7637:0:(genops.c:885:class_export_put()) final put ffff99a704f1d800/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:3.0:1788448411.296845:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704f1d800/af250c24-64ec-487b-a1ec-11a62017775a for lustre-OST0001 00000020:00000080:3.0:1788448411.296971:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a704f1f800 for lustre-OST0001 00000100:00100000:2.0:1788448412.084469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448412.084571:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448412.085061:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763008 00000100:00100000:3.0:1788448412.085072:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763008 00000100:00100000:3.0:1788448412.085164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:3.0:1788448412.085175:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902763008:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448412.085302:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902763008:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 128us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448412.085311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00080000:2.0:1788448412.086076:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448412.087426:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902762880 00000100:00100000:1.0:1788448412.087441:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902762880 00000100:00100000:1.0:1788448412.087523:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 197 00000100:00100000:1.0:1788448412.087534:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902762880:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448412.087611:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902762880:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 79us (3172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448412.087619:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 197 00010000:00010000:1.0:1788448412.192557:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448413.216526:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448413.273485:0:9334:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.103 00000100:00100000:1.0:1788448413.289317:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926910976:0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.289393:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448413.289465:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448413.289472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911104:0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.289500:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448413.289539:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910976 00000100:00100000:1.0:1788448413.289546:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910976 00000100:00100000:1.0:1788448413.289602:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448413.289612:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926910976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.289660:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926910976:12345-0@lo:400:kworker.0 Request processed in 51us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.289666:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448413.289687:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911104 00000100:00100000:1.0:1788448413.289691:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911104 00000100:00100000:1.0:1788448413.289716:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448413.289723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.289762:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911104:12345-0@lo:400:kworker.0 Request processed in 39us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.289768:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1788448413.289786:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448413.289789:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448413.289814:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a7056c4e00 x1875323926911104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448413.289827:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911104:0@lo:400:kworker.0 00000100:00100000:1.0:1788448413.289836:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926910976:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.289931:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926910720:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.289998:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.290025:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926911232:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290049:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.290067:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788448413.290073:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926910848:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290103:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.290119:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926911360:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290139:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448413.290166:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910720 00000100:00100000:0.0:1788448413.290169:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910720 00000100:00100000:0.0:1788448413.290223:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788448413.290230:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926910720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290262:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926910720:12345-0@lo:400:kworker.0 Request processed in 34us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.290268:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1788448413.290297:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911232 00000100:00100000:0.0:1788448413.290300:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911232 00000100:00100000:0.0:1788448413.290322:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926910848 00000100:00100000:0.0:1788448413.290325:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926910848 00000100:00100000:0.0:1788448413.290339:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448413.290344:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926911232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290372:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926911232:12345-0@lo:400:kworker.0 Request processed in 28us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.290378:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448413.290389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448413.290395:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926910848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290429:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926910848:12345-0@lo:400:kworker.0 Request processed in 34us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448413.290434:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448413.290459:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926910848:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290467:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a706c9ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926910720:0@lo:400:kworker.0 00000100:00100000:0.0:1788448413.290474:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926911232:0@lo:400:kworker.0 00000100:00100000:3.0:1788448413.290663:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911360 00000100:00100000:3.0:1788448413.290668:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911360 00000100:00100000:3.0:1788448413.290696:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448413.290703:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926911360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448413.290742:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926911360:12345-0@lo:400:kworker.0 Request processed in 40us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448413.290755:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788448413.290781:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83cca7800 x1875323926911360/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448413.290791:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926911360:0@lo:400:kworker.0 00000100:00080000:1.0:1788448413.296012:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448413.296024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448413.805539:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448413.805616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448413.805703:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911488 00000100:00100000:1.0:1788448413.805713:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911488 00000100:00100000:1.0:1788448413.805762:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788448413.805978:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448413.806017:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448413.806116:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448413.806123:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788448413.814247:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83cca6d80 x1875323926911488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448413.814281:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911488:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788448414.240405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448415.265743:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448416.288383:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448416.352545:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448416.352568:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911616:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448416.352647:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448416.352731:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911616 00000100:00100000:2.0:1788448416.352742:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911616 00000100:00100000:2.0:1788448416.352794:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448416.352804:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448416.352838:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448416.352879:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926911616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448416.352886:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788448416.352921:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807975c00 x1875323926911616/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448432 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448416.352939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926911616:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448416.353467:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:3.0:1788448416.495453:0:9432:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.103 00000100:00100000:2.0:1788448417.210915:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448417.210960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448417.211057:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763136 00000100:00100000:3.0:1788448417.211067:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763136 00000100:00100000:3.0:1788448417.211131:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 199 00000100:00100000:3.0:1788448417.211150:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902763136:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448417.211243:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902763136:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 95us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448417.211252:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 199 00000100:00100000:0.0:1788448417.218246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763264 00000100:00100000:0.0:1788448417.218267:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763264 00000100:00100000:0.0:1788448417.218366:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00080000:1.0:1788448417.218478:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448417.222512:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902763264:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448417.222634:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902763264:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 4257us (11672us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448417.222645:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00010000:00010000:2.0:1788448417.316948:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448418.337474:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448418.402495:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926912000:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.402558:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.402864:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448418.402871:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926912128:0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.402901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448418.402944:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912128 00000100:00100000:0.0:1788448418.402954:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912128 00000100:00100000:0.0:1788448418.403037:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788448418.403046:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926912128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448418.403100:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926912128:12345-0@lo:400:kworker.0 Request processed in 55us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448418.403107:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1788448418.403127:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448418.403152:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce35180 x1875323926912128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448418.403165:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926912128:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.403361:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926911872:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.403400:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.403428:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926912384:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.403449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.403490:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448418.403495:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926911744:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.403520:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.403539:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926912256:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.403560:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448418.403882:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912000 00000100:00100000:2.0:1788448418.403888:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912000 00000100:00100000:2.0:1788448418.403929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911872 00000100:00100000:2.0:1788448418.403932:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911872 00000100:00100000:2.0:1788448418.403942:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912256 00000100:00100000:2.0:1788448418.403945:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912256 00000100:00100000:2.0:1788448418.403958:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448418.403965:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926912000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404015:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926912000:12345-0@lo:400:kworker.0 Request processed in 50us (1456us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.404022:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788448418.404034:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448418.404040:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926911872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404072:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926911872:12345-0@lo:400:kworker.0 Request processed in 32us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.404077:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448418.404088:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448418.404094:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926912256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404120:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926912256:12345-0@lo:400:kworker.0 Request processed in 27us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.404126:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788448418.404158:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926912256:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404170:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926911872:0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404225:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912384 00000100:00100000:2.0:1788448418.404229:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912384 00000100:00100000:2.0:1788448418.404254:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448418.404260:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926912384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448418.404294:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926912384:12345-0@lo:400:kworker.0 Request processed in 34us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448418.404307:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788448418.404334:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce34a80 x1875323926912384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448418.404344:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926912384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448418.404650:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926911744 00000100:00100000:1.0:1788448418.404661:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926911744 00000100:00100000:1.0:1788448418.404704:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788448418.404713:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926911744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448418.404760:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926911744:12345-0@lo:400:kworker.0 Request processed in 49us (1238us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448418.404765:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1788448418.404801:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926911744:0@lo:400:kworker.0 00000100:00080000:0.0:1788448418.407509:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448418.407520:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448418.407643:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926912000:0@lo:400:kworker.0 00000001:02000400:3.0:1788448418.579885:0:9481:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 3 11:13:35 EDT 2026 00000100:00100000:2.0:1788448418.912546:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448418.912572:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926912512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448418.912648:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448418.912802:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912512 00000100:00100000:1.0:1788448418.912812:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912512 00000100:00100000:1.0:1788448418.912869:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448418.912880:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926912512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448418.912919:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448418.912976:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926912512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448418.912994:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:3.0:1788448418.913433:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83cca7b80 x1875323926912512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448418.913455:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926912512:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448419.360530:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448420.388256:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448421.409492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448421.473109:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448421.473145:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926912640:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448421.473276:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448421.473384:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912640 00000100:00100000:0.0:1788448421.473394:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912640 00000100:00100000:0.0:1788448421.473478:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448421.473488:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926912640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448421.473530:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448421.473774:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926912640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 286us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448421.473782:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1788448421.473833:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448421.474224:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce34e00 x1875323926912640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448437 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448421.474268:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926912640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448422.324588:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448422.324658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448422.324704:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763392 00000100:00100000:2.0:1788448422.324717:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763392 00000100:00100000:2.0:1788448422.324787:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:2.0:1788448422.324799:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902763392:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448422.324888:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902763392:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 91us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448422.324896:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:3.0:1788448422.325824:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763520 00000100:00100000:3.0:1788448422.325835:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763520 00000100:00100000:3.0:1788448422.325929:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1788448422.325941:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902763520:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448422.326004:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902763520:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 66us (1432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448422.326012:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00080000:2.0:1788448422.327612:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448422.433524:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448423.456416:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448423.533944:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926912768:0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.534031:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448423.534230:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912768 00000100:00100000:3.0:1788448423.534246:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912768 00000100:00100000:3.0:1788448423.534300:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1788448423.534311:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926912768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448423.534749:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926912768:12345-0@lo:400:kworker.0 Request processed in 439us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448423.534757:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:2.0:1788448423.534962:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448423.534973:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926913024:0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.535005:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.535038:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913024 00000100:00100000:2.0:1788448423.535042:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913024 00000100:00100000:2.0:1788448423.535096:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448423.535103:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926913024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.535142:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926913024:12345-0@lo:400:kworker.0 Request processed in 41us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.535149:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788448423.535168:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448423.535214:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926912896:0@lo:400:kworker.0 00000100:00100000:0.0:1788448423.535250:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448423.535291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926912896 00000100:00100000:0.0:1788448423.535296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926912896 00000100:00100000:2.0:1788448423.536320:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926913024:0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.536669:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913152:0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.536714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.536758:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913152 00000100:00100000:2.0:1788448423.536765:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913152 00000100:00100000:2.0:1788448423.537314:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448423.537324:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.537492:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835420700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926912768:0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.537571:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913152:12345-0@lo:400:kworker.0 Request processed in 248us (856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.537578:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:2.0:1788448423.537737:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448423.537759:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835421f80 x1875323926913152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448423.537772:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.538449:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926913280:0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.538491:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448423.538522:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448423.538527:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926913408:0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.538551:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448423.538672:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913280 00000100:00100000:2.0:1788448423.538678:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913280 00000100:00100000:1.0:1788448423.538701:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913408 00000100:00100000:1.0:1788448423.538711:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913408 00000100:00100000:1.0:1788448423.538760:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788448423.538768:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926913408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448423.540387:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926913408:12345-0@lo:400:kworker.0 Request processed in 1611us (1827us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448423.540401:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1788448423.540436:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788448423.540471:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835421180 x1875323926913408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448423.540486:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926913408:0@lo:400:kworker.0 00000100:00100000:0.0:1788448423.541015:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448423.541026:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926912896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448423.541074:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926912896:12345-0@lo:400:kworker.0 Request processed in 50us (5824us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448423.541081:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448423.541116:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926912896:0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.542223:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448423.542235:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926913280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448423.542294:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926913280:12345-0@lo:400:kworker.0 Request processed in 61us (3801us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448423.542312:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448423.542348:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926913280:0@lo:400:kworker.0 00000100:00080000:1.0:1788448423.552085:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448424.039582:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448424.039616:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913536:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448424.039733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448424.039962:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913536 00000100:00100000:1.0:1788448424.039974:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913536 00000100:00100000:1.0:1788448424.040061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448424.040074:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448424.040127:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448424.040223:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448424.040231:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788448424.040471:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83cca5880 x1875323926913536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448424.040494:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913536:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448424.483775:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448425.505397:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448426.528887:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448426.592624:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448426.592710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448426.592947:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913664 00000100:00100000:0.0:1788448426.592957:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913664 00000100:00100000:0.0:1788448426.593037:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788448426.593047:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448426.593080:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448426.593129:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926913664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448426.593137:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1788448426.593181:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce36680 x1875323926913664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448442 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448426.593223:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926913664:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448426.593330:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448427.444170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448427.444250:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448427.444325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763776 00000100:00100000:3.0:1788448427.444336:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763776 00000100:00100000:0.0:1788448427.444355:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763648 00000100:00100000:0.0:1788448427.444359:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763648 00000100:00100000:3.0:1788448427.444402:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:0.0:1788448427.444402:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:3.0:1788448427.444413:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902763776:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448427.444413:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902763648:12345-192.168.204.37@tcp:400:kworker.0 00000100:00080000:2.0:1788448427.444489:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448427.444490:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902763776:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 78us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448427.444498:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:0.0:1788448427.445861:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902763648:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 1443us (1602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448427.445873:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 203 00010000:00010000:2.0:1788448427.557940:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448428.579228:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448428.640730:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926914048:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.640837:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448428.640906:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448428.640913:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926914176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.640944:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448428.640991:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914048 00000100:00100000:0.0:1788448428.641002:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914048 00000100:00100000:0.0:1788448428.641071:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448428.641083:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926914048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.641141:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926914048:12345-0@lo:400:kworker.0 Request processed in 61us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.641149:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448428.641176:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914176 00000100:00100000:0.0:1788448428.641180:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914176 00000100:00100000:0.0:1788448428.641232:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788448428.641239:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926914176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.641268:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926914176:12345-0@lo:400:kworker.0 Request processed in 30us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.641273:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788448428.641288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448428.641293:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1788448428.641324:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce36d80 x1875323926914176/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448428.641354:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926914176:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.641369:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926914048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.641805:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926913792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.641902:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448428.641965:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913792 00000100:00100000:0.0:1788448428.641975:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913792 00000100:00100000:1.0:1788448428.641976:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926914304:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.642028:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788448428.642040:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448428.642042:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926913792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.642110:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926913792:12345-0@lo:400:kworker.0 Request processed in 72us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.642118:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1788448428.642129:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926913792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.642150:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788448428.642161:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926913920:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.642238:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448428.642265:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926914432:0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.642276:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914304 00000100:00100000:0.0:1788448428.642283:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914304 00000100:00100000:0.0:1788448428.642316:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926913920 00000100:00100000:0.0:1788448428.642320:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926913920 00000100:00100000:0.0:1788448428.642338:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448428.642344:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926914304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.642385:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926914304:12345-0@lo:400:kworker.0 Request processed in 41us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.642391:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448428.642403:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448428.642409:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926913920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448428.642438:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926913920:12345-0@lo:400:kworker.0 Request processed in 29us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448428.642443:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:0.0:1788448428.642459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448428.642854:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448428.642898:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926914304:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.642922:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926913920:0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.642964:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914432 00000100:00100000:1.0:1788448428.642970:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914432 00000100:00100000:1.0:1788448428.643030:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788448428.643039:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926914432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448428.643435:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926914432:12345-0@lo:400:kworker.0 Request processed in 396us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448428.643446:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:1.0:1788448428.643860:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788448428.643911:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc11500 x1875323926914432/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448444 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448428.643924:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926914432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448429.155565:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926914560:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448429.155668:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448429.155763:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914560 00000100:00100000:3.0:1788448429.155791:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914560 00000100:00100000:3.0:1788448429.155854:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448429.155864:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926914560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448429.155916:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448429.155985:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926914560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448429.155993:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788448429.156048:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835aff800 x1875323926914560/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448429.156071:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926914560:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448429.600439:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448430.627155:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448431.651420:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448431.713476:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448431.713556:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448431.713638:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914688 00000100:00100000:0.0:1788448431.713646:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914688 00000100:00100000:0.0:1788448431.713707:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1788448431.713883:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448431.713897:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926914688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448431.713933:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448431.713985:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926914688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 270us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448431.713993:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:2.0:1788448431.715502:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc13480 x1875323926914688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448447 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448431.715529:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc13480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448432.568094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448432.568145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448432.568443:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902763904 00000100:00100000:0.0:1788448432.568454:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902763904 00000100:00100000:0.0:1788448432.568502:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:0.0:1788448432.568512:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902763904:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448432.568582:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+10:2352:x1875323902763904:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 71us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448432.568589:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:1.0:1788448432.569092:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764032 00000100:00100000:1.0:1788448432.569099:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764032 00000100:00100000:1.0:1788448432.569155:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:1.0:1788448432.569163:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902764032:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448432.569238:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902764032:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 75us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448432.569245:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00080000:0.0:1788448432.569500:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448432.674044:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448433.696410:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448433.760757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926914944:0@lo:400:kworker.0 00000100:00100000:3.0:1788448433.760833:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926915072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.760840:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448433.760864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.760928:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926914816:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.760963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448433.760968:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448433.760973:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926915200:0@lo:400:kworker.0 00000100:00100000:3.0:1788448433.761003:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448433.761441:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914944 00000100:00100000:0.0:1788448433.761462:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914944 00000100:00100000:0.0:1788448433.761511:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915072 00000100:00100000:0.0:1788448433.761515:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915072 00000100:00100000:0.0:1788448433.761545:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448433.761555:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926914944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.761621:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926914944:12345-0@lo:400:kworker.0 Request processed in 67us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448433.761642:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448433.761676:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448433.761684:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926915072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.761726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835affb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926915072:12345-0@lo:400:kworker.0 Request processed in 44us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448433.761732:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:0.0:1788448433.761751:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448433.761777:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926914816 00000100:00100000:0.0:1788448433.761780:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926914816 00000100:00100000:0.0:1788448433.761806:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788448433.761813:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926914816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.761842:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926914816:12345-0@lo:400:kworker.0 Request processed in 30us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448433.761848:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1788448433.761901:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915200 00000100:00100000:0.0:1788448433.761906:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915200 00000100:00100000:0.0:1788448433.761935:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788448433.762214:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926915200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448433.762247:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926915200:12345-0@lo:400:kworker.0 Request processed in 307us (1243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448433.762254:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788448433.762269:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448433.767229:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926914816:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.767248:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926915328:0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.767317:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.767394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915328 00000100:00100000:1.0:1788448433.767401:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915328 00000100:00100000:1.0:1788448433.767454:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788448433.767462:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926915328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.767521:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926915328:12345-0@lo:400:kworker.0 Request processed in 59us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.767528:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:1.0:1788448433.767550:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448433.767569:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926915328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.771489:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926914944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.771505:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926915456:0@lo:400:kworker.0 00000100:00100000:2.0:1788448433.771570:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448433.773983:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915456 00000100:00100000:1.0:1788448433.774002:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915456 00000100:00100000:1.0:1788448433.774800:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788448433.774811:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926915456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448433.774901:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926915456:12345-0@lo:400:kworker.0 Request processed in 92us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448433.774908:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:1.0:1788448433.774984:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc12d80 x1875323926915456/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448433.774998:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926915456:0@lo:400:kworker.0 00000100:00080000:2.0:1788448433.776881:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788448433.778622:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc11c00 x1875323926915200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448449 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448433.778642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926915200:0@lo:400:kworker.0 00000100:00100000:3.0:1788448433.778659:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926915072:0@lo:400:kworker.0 00000100:00100000:2.0:1788448434.272453:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448434.272489:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926915584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448434.272563:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448434.272771:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915584 00000100:00100000:3.0:1788448434.272796:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915584 00000100:00100000:3.0:1788448434.272850:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448434.272860:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926915584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448434.272898:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448434.272953:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926915584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448434.272961:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:2.0:1788448434.273093:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835aff100 x1875323926915584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448434.273110:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926915584:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448434.720507:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448435.012094:0:10111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 11:13:52 (1788448432) === 00000100:00100000:3.0:1788448435.517980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.518234:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764160 00000100:00100000:0.0:1788448435.518248:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764160 00000100:00100000:0.0:1788448435.518336:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:0.0:1788448435.518349:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+10:8122:x1875323902764160:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448435.518393:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448435.518419:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90aaf05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510932 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448435.518468:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90aaf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510932 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448435.518484:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90aaf05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510932 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448435.518495:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec400, rc 0) 00000100:00100000:0.0:1788448435.518825:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764160:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 477us (860us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.518834:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:1.0:1788448435.526816:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.527087:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764288 00000100:00100000:0.0:1788448435.527102:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764288 00000100:00100000:0.0:1788448435.535204:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:0.0:1788448435.535234:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764288:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448435.536058:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764288:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 833us (9252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.536071:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:2.0:1788448435.547162:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.547326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764416 00000100:00100000:0.0:1788448435.547339:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764416 00000100:00100000:0.0:1788448435.547444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:0.0:1788448435.547465:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764416:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448435.547987:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764416:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 529us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.548009:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:1.0:1788448435.558067:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.558815:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764544 00000100:00100000:0.0:1788448435.558830:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764544 00000100:00100000:0.0:1788448435.558910:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:0.0:1788448435.558923:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:8126:x1875323902764544:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448435.559886:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:8126:x1875323902764544:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 957us (1826us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.559910:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:1.0:1788448435.579558:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.579806:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764672 00000100:00100000:0.0:1788448435.579822:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764672 00000100:00100000:0.0:1788448435.579901:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1788448435.579914:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+11:8126:x1875323902764672:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448435.580487:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+11:8126:x1875323902764672:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 570us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.580498:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1788448435.587501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.587758:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764800 00000100:00100000:2.0:1788448435.587774:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764800 00000100:00100000:2.0:1788448435.587863:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:2.0:1788448435.587875:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:8122:x1875323902764800:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448435.587902:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448435.587926:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aaf0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba051095c expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448435.587967:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aaf0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051095c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448435.587980:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aaf0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051095c expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448435.587991:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178e00, rc 0) 00000100:00100000:2.0:1788448435.588064:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+12:8122:x1875323902764800:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 191us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.588073:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:1.0:1788448435.593931:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.594513:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902764928 00000100:00100000:2.0:1788448435.594528:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902764928 00000100:00100000:2.0:1788448435.594610:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:2.0:1788448435.594622:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:8122:x1875323902764928:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:2.0:1788448435.594665:0:5831:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1788448435.594695:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1788448435.594700:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1788448435.594703:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1788448435.594710:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1788448435.601236:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:8122:x1875323902764928:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 6567us (7278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.601251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:3.0:1788448435.605100:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.613863:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765056 00000100:00100000:0.0:1788448435.614029:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765056 00000100:00100000:1.0:1788448435.622058:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:1.0:1788448435.622076:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:8122:x1875323902765056:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448435.622100:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448435.622127:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510963 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448435.622164:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448435.622176:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448435.622220:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:1.0:1788448435.622309:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:8122:x1875323902765056:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 236us (17226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448435.622317:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:1.0:1788448435.624968:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.625732:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765184 00000100:00100000:2.0:1788448435.625747:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765184 00000100:00100000:2.0:1788448435.625956:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:2.0:1788448435.625972:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:8122:x1875323902765184:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788448435.627374:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:8122:x1875323902765184:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 1390us (2405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.627403:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:2.0:1788448435.634045:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.634159:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765312 00000100:00100000:0.0:1788448435.634172:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765312 00000100:00100000:1.0:1788448435.634645:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:1.0:1788448435.634673:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:8122:x1875323902765312:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448435.635213:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:8122:x1875323902765312:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 528us (1155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448435.635223:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:2.0:1788448435.643538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.643720:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765440 00000100:00100000:0.0:1788448435.643735:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765440 00000100:00100000:0.0:1788448435.643821:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:0.0:1788448435.643835:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:8131:x1875323902765440:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448435.644241:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:8131:x1875323902765440:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 408us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.644251:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:2.0:1788448435.650351:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448435.650686:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765568 00000100:00100000:1.0:1788448435.650701:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765568 00000100:00100000:1.0:1788448435.650777:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:1.0:1788448435.650790:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:8131:x1875323902765568:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448435.651240:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:8131:x1875323902765568:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 449us (905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448435.651250:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:2.0:1788448435.661441:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.661491:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.661603:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765952 00000100:00100000:0.0:1788448435.661636:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765952 00000100:00100000:0.0:1788448435.661742:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765696 00000100:00100000:0.0:1788448435.661746:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765696 00000100:00100000:0.0:1788448435.661776:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:0.0:1788448435.661788:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902765952:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448435.661885:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902765952:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 100us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.661893:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:0.0:1788448435.661912:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1788448435.661917:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2351:x1875323902765696:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788448435.661944:0:7154:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from dde44bfc-ee66-4f31-86da-76b8fbe861b2@192.168.204.37@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:0.0:1788448435.661987:0:7154:0:(genops.c:1385:class_connect()) connect: client dde44bfc-ee66-4f31-86da-76b8fbe861b2, cookie 0xd0e9b344b90aaf1a 00000004:00100000:0.0:1788448435.662026:0:7154:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788448435.662413:0:7154:0:(import.c:65:import_set_state_nolock()) ffff99a834f68800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448435.662451:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2351:x1875323902765696:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 532us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.662459:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00080000:0.0:1788448435.663610:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448435.665500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.665749:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448435.668561:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902765824 00000100:00100000:1.0:1788448435.668592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902765824 00000100:00100000:1.0:1788448435.668709:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766080 00000100:00100000:1.0:1788448435.668714:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766080 00000100:00100000:1.0:1788448435.668755:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1788448435.668767:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+7:0:x1875323902765824:12345-192.168.204.37@tcp:41:mount.lustre.0 00000100:00100000:2.0:1788448435.668970:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448435.668984:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+7:8122:x1875323902766080:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788448435.669049:0:7154:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1788448435.669177:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+7:8122:x1875323902766080:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 197us (3428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.669206:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000004:00000024:1.0:1788448435.670523:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788448435.670607:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:0:x1875323902765824:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 1829us (5106us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448435.670617:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:0.0:1788448435.671032:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448435.672930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.673671:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766208 00000100:00100000:0.0:1788448435.673688:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766208 00000100:00100000:0.0:1788448435.673778:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1788448435.673791:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:8122:x1875323902766208:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788448435.673916:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835422a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:8122:x1875323902766208:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 128us (2575us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448435.673924:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1788448435.683400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.683450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448435.683527:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448435.683713:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766336 00000100:00100000:2.0:1788448435.683742:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766336 00000100:00100000:2.0:1788448435.683795:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766464 00000100:00100000:3.0:1788448435.683798:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766592 00000100:00100000:2.0:1788448435.683799:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766464 00000100:00100000:3.0:1788448435.683806:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766592 00000100:00100000:2.0:1788448435.683822:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448435.683833:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902766336:12345-192.168.204.37@tcp:8:mount.lustre.0 00000100:00100000:3.0:1788448435.683853:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448435.683863:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:8122:x1875323902766592:12345-192.168.204.37@tcp:33:mount.lustre.0 00010000:00080000:2.0:1788448435.683878:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from dde44bfc-ee66-4f31-86da-76b8fbe861b2@192.168.204.37@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:2.0:1788448435.683932:0:6683:0:(genops.c:1385:class_connect()) connect: client dde44bfc-ee66-4f31-86da-76b8fbe861b2, cookie 0xd0e9b344b90aaf21 00002000:00100000:2.0:1788448435.683948:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli dde44bfc-ee66-4f31-86da-76b8fbe861b2/ffff99a835b99800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00000004:00200000:3.0:1788448435.683968:0:5840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00002000:00100000:2.0:1788448435.683983:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788448435.684089:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:8122:x1875323902766592:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 227us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448435.684098:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00002000:00080000:2.0:1788448435.685561:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448435.685729:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a835b9f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448435.686786:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2351:x1875323902766336:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 2945us (3325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.686800:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448435.686840:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448435.686848:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902766464:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448435.686884:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from dde44bfc-ee66-4f31-86da-76b8fbe861b2@192.168.204.37@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:2.0:1788448435.686923:0:6683:0:(genops.c:1385:class_connect()) connect: client dde44bfc-ee66-4f31-86da-76b8fbe861b2, cookie 0xd0e9b344b90aaf28 00002000:00100000:2.0:1788448435.686938:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli dde44bfc-ee66-4f31-86da-76b8fbe861b2/ffff99a835b9b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448435.686965:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448435.687208:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448435.687243:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a835b9e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448435.687297:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2351:x1875323902766464:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 449us (3780us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448435.687305:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00010000:00010000:0.0:1788448435.744484:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448436.768718:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448436.839718:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926915712:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448436.839828:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448436.839934:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915712 00000100:00100000:0.0:1788448436.839944:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915712 00000100:00100000:0.0:1788448436.840024:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788448436.840035:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926915712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448436.840065:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448436.840119:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926915712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448436.840126:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1788448436.840154:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788448436.840247:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc10700 x1875323926915712/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448452 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448436.840355:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926915712:0@lo:13:osp-pre-0-0.0 00000001:00100000:2.0:1788448436.912834:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000001:00100000:1.0:1788448436.918144:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00010000:00010000:0.0:1788448437.792630:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448438.817265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448438.880605:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926916224:0@lo:400:kworker.0 00000100:00100000:2.0:1788448438.880845:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448438.880932:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448438.880940:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926916096:0@lo:400:kworker.0 00000100:00100000:2.0:1788448438.881009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448438.881057:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916224 00000100:00100000:2.0:1788448438.881068:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916224 00000100:00100000:2.0:1788448438.881145:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448438.881159:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926916224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448438.881278:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926916224:12345-0@lo:400:kworker.0 Request processed in 122us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448438.881286:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448438.881433:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926915968:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.881480:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.881536:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926915840:0@lo:400:kworker.0 00000100:00100000:1.0:1788448438.881578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448438.881621:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926916352:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.886141:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926916480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.886258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448438.886344:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915840 00000100:00100000:3.0:1788448438.886354:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915840 00000100:00100000:3.0:1788448438.886418:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788448438.886445:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926915840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.886610:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448438.886656:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916096 00000100:00100000:0.0:1788448438.886661:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916096 00000100:00100000:0.0:1788448438.886699:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926915968 00000100:00100000:0.0:1788448438.886703:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926915968 00000100:00100000:0.0:1788448438.886729:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916352 00000100:00100000:0.0:1788448438.886732:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916352 00000100:00100000:0.0:1788448438.886746:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448438.886754:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926916096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.886831:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926916096:12345-0@lo:400:kworker.0 Request processed in 78us (5821us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.886839:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448438.886859:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448438.886865:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926915968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.886901:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926915968:12345-0@lo:400:kworker.0 Request processed in 36us (5421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.886906:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788448438.886918:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448438.886924:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926916352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.886955:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926916352:12345-0@lo:400:kworker.0 Request processed in 32us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.886962:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448438.887004:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926916352:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.887039:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926915968:0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.887914:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916480 00000100:00100000:0.0:1788448438.887925:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916480 00000100:00100000:0.0:1788448438.887978:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448438.887987:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926916480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448438.888057:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926916480:12345-0@lo:400:kworker.0 Request processed in 71us (1800us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448438.888064:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:0.0:1788448438.888088:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448438.888094:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448438.888098:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448438.888149:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835423b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926916096:0@lo:400:kworker.0 00010000:00080000:0.0:1788448438.888170:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835422300 x1875323926916224/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448438.888181:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926916224:0@lo:400:kworker.0 00010000:00080000:0.0:1788448438.888238:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835421180 x1875323926916480/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448454 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448438.888248:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926916480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448438.888868:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926915840:12345-0@lo:400:kworker.0 Request processed in 2420us (7283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448438.888881:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788448438.889114:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926915840:0@lo:400:kworker.0 00000100:00100000:0.0:1788448439.392494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926916608:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448439.392616:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448439.392928:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916608 00000100:00100000:2.0:1788448439.392940:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916608 00000100:00100000:2.0:1788448439.393006:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448439.393017:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926916608:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448439.393064:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448439.393126:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926916608:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448439.393134:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:0.0:1788448439.397054:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b0000 x1875323926916608/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448439.397084:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926916608:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788448439.840753:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448440.010349:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000100:00100000:2.0:1788448440.766579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448440.766629:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448440.766682:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448440.766713:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448440.766739:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448440.766894:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766720 00000100:00100000:1.0:1788448440.766908:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766720 00000100:00100000:1.0:1788448440.766983:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:1.0:1788448440.766995:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902766720:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448440.767086:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902766720:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 94us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448440.767094:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:3.0:1788448440.767542:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766976 00000100:00100000:3.0:1788448440.767550:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766976 00000100:00100000:3.0:1788448440.767618:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902766848 00000100:00100000:3.0:1788448440.767622:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902766848 00000100:00100000:3.0:1788448440.767649:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1788448440.767659:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902766976:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448440.767714:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902766976:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 58us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448440.767721:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1788448440.767739:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:3.0:1788448440.767745:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902766848:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448440.767769:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902766848:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (1055us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448440.767774:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:3.0:1788448440.767891:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767232 00000100:00100000:3.0:1788448440.767896:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767232 00000100:00100000:3.0:1788448440.767926:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767104 00000100:00100000:3.0:1788448440.767930:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767104 00000100:00100000:3.0:1788448440.767947:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1788448440.767954:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902767232:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448440.767990:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902767232:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 36us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448440.768015:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1788448440.768028:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:3.0:1788448440.768034:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902767104:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448440.768060:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902767104:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448440.768066:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00080000:1.0:1788448440.768631:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448440.768637:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448440.768640:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448440.864486:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448441.414864:0:10309:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:0.0:1788448441.888372:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448441.952808:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926916736:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448441.952903:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448441.955402:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916736 00000100:00100000:2.0:1788448441.955418:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916736 00000100:00100000:2.0:1788448441.955495:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448441.955505:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926916736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448441.955551:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448441.955631:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926916736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (2728us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448441.955638:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1788448441.955736:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788448441.955802:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b2680 x1875323926916736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448457 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448441.955824:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926916736:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788448442.914513:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448443.938582:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448444.000742:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926916864:0@lo:400:kworker.0 00000100:00100000:2.0:1788448444.000847:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448444.001006:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926916992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.001044:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448444.001107:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916992 00000100:00100000:1.0:1788448444.001119:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916992 00000100:00100000:1.0:1788448444.001212:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448444.001223:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926916992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.001285:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926916992:12345-0@lo:400:kworker.0 Request processed in 63us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448444.001292:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448444.001346:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc13800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926916992:0@lo:400:kworker.0 00000100:00100000:3.0:1788448444.001534:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926916864 00000100:00100000:3.0:1788448444.001540:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926916864 00000100:00100000:3.0:1788448444.001583:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1788448444.001591:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926916864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.002215:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926917248:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.002259:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.002288:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448444.002293:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926917120:0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.002316:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448444.002347:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917248 00000100:00100000:0.0:1788448444.002352:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917248 00000100:00100000:3.0:1788448444.002568:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926916864:12345-0@lo:400:kworker.0 Request processed in 977us (1720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.002576:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1788448444.002856:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926917504:0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.002890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448444.002921:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448444.002927:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926917376:0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.002983:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448444.003025:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917120 00000100:00100000:1.0:1788448444.003031:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917120 00000100:00100000:1.0:1788448444.003078:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917376 00000100:00100000:1.0:1788448444.003082:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917376 00000100:00100000:1.0:1788448444.003105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448444.003115:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926917120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.003163:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926917120:12345-0@lo:400:kworker.0 Request processed in 50us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448444.003170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448444.003205:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448444.003212:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926917376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.003243:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926917376:12345-0@lo:400:kworker.0 Request processed in 32us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448444.003249:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788448444.003267:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448444.003301:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926917120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.003333:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926917376:0@lo:400:kworker.0 00000100:00100000:3.0:1788448444.004953:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917504 00000100:00100000:3.0:1788448444.004970:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917504 00000100:00100000:3.0:1788448444.005082:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448444.005094:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926917504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448444.005247:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926917504:12345-0@lo:400:kworker.0 Request processed in 155us (2355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.005256:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448444.005421:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448444.005439:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926917248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448444.005818:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926917248:12345-0@lo:400:kworker.0 Request processed in 378us (3555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448444.005825:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788448444.005931:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc12d80 x1875323926917248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448444.005949:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926917248:0@lo:400:kworker.0 00000100:00080000:1.0:1788448444.006035:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448444.006042:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1788448444.006072:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc12a00 x1875323926917504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448444.006083:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926917504:0@lo:400:kworker.0 00000100:00100000:2.0:1788448444.015631:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926916864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448444.516816:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926917632:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448444.516915:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448444.517095:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917632 00000100:00100000:3.0:1788448444.517108:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917632 00000100:00100000:3.0:1788448444.517173:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448444.517206:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926917632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448444.517259:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448444.520630:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926917632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3436us (3702us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448444.520649:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1788448444.521080:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b3b80 x1875323926917632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448444.521135:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926917632:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448444.960515:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448445.878355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448445.878418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448445.878474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448445.878496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448445.878539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448445.878573:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767616 00000100:00100000:1.0:1788448445.878573:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767488 00000100:00100000:2.0:1788448445.878585:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767616 00000100:00100000:1.0:1788448445.878585:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767488 00000100:00100000:0.0:1788448445.878660:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767744 00000100:00100000:0.0:1788448445.878665:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767744 00000100:00100000:1.0:1788448445.878754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:1.0:1788448445.878768:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902767488:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448445.878871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902767488:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 107us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448445.878879:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:1.0:1788448445.878906:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767872 00000100:00100000:1.0:1788448445.878908:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767872 00000100:00100000:2.0:1788448445.882449:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1788448445.882482:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767616:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448445.882588:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767616:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 113us (4089us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448445.882598:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:2.0:1788448445.882642:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902767360 00000100:00100000:2.0:1788448445.882652:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902767360 00000100:00100000:2.0:1788448445.882689:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:2.0:1788448445.882696:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902767360:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448445.882726:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902767360:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (4252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448445.882748:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:0.0:1788448445.885053:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:0.0:1788448445.885078:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767744:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448445.885177:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767744:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 109us (6757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448445.885205:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00080000:0.0:1788448445.885281:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448445.885288:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448445.885292:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448445.891935:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1788448445.891970:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a809240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767872:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448445.892117:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a809240050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902767872:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 162us (13575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448445.892125:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00010000:00010000:0.0:1788448445.985372:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448447.008523:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448447.077160:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926917760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448447.077308:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448447.077354:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917760 00000100:00100000:2.0:1788448447.077367:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917760 00000100:00100000:2.0:1788448447.078472:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448447.078495:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926917760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448447.078624:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448447.078717:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926917760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 232us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448447.078725:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1788448447.078759:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448447.078804:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b2300 x1875323926917760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448463 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448447.078829:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926917760:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788448448.032529:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448449.056982:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448449.124717:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926918016:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.124829:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.124892:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926918528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.124924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.124961:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788448449.124967:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926917888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125004:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.125028:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926918400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125053:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.125085:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926918272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125125:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.125147:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448449.125153:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926918144:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.125264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918016 00000100:00100000:3.0:1788448449.125274:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918016 00000100:00100000:3.0:1788448449.125329:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918400 00000100:00100000:3.0:1788448449.125332:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918400 00000100:00100000:3.0:1788448449.125375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918144 00000100:00100000:3.0:1788448449.125379:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918144 00000100:00100000:3.0:1788448449.125410:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448449.125422:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926918016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125494:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926918016:12345-0@lo:400:kworker.0 Request processed in 73us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125502:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448449.125529:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448449.125536:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926918400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125567:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926918400:12345-0@lo:400:kworker.0 Request processed in 32us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125573:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448449.125590:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448449.125596:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926918144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125627:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926918144:12345-0@lo:400:kworker.0 Request processed in 32us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448449.125655:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926917888 00000100:00100000:3.0:1788448449.125658:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926917888 00000100:00100000:3.0:1788448449.125696:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788448449.125703:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926917888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125736:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926917888:12345-0@lo:400:kworker.0 Request processed in 34us (731us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125742:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788448449.125779:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918528 00000100:00100000:3.0:1788448449.125783:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918528 00000100:00100000:3.0:1788448449.125812:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918272 00000100:00100000:3.0:1788448449.125814:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918272 00000100:00100000:3.0:1788448449.125830:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448449.125836:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926918528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125866:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926918528:12345-0@lo:400:kworker.0 Request processed in 30us (942us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125873:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788448449.125883:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788448449.125889:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926918272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.125915:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926918272:12345-0@lo:400:kworker.0 Request processed in 27us (790us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.125921:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:3.0:1788448449.125944:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448449.125949:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448449.125952:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448449.125994:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926918144:0@lo:400:kworker.0 00010000:00080000:3.0:1788448449.126011:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e5f80 x1875323926918272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448449.126022:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926918272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.126073:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926917888:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.126086:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926918400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448449.126098:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926918016:0@lo:400:kworker.0 00010000:00080000:3.0:1788448449.126108:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e7800 x1875323926918528/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448449.126119:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926918528:0@lo:400:kworker.0 00000100:00100000:2.0:1788448449.640169:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926918656:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448449.640267:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448449.640397:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918656 00000100:00100000:3.0:1788448449.640406:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918656 00000100:00100000:3.0:1788448449.640462:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788448449.640473:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926918656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448449.640510:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1788448449.652745:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc10e00 x1875323926918656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448449.652779:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926918656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448449.658140:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926918656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 17656us (17860us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448449.658353:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1788448450.081144:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448450.994943:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448450.995074:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768000 00000100:00100000:3.0:1788448450.995090:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768000 00000100:00100000:3.0:1788448450.995166:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:3.0:1788448450.995180:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902768000:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448450.995311:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902768000:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 134us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448450.995321:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:0.0:1788448450.997800:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448450.997901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768128 00000100:00100000:3.0:1788448450.997914:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768128 00000100:00100000:3.0:1788448450.998009:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:3.0:1788448450.998036:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902768128:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448450.998121:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902768128:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 89us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448450.998130:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00080000:0.0:1788448450.999323:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448451.012843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448451.013842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448451.013889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768256 00000100:00100000:0.0:1788448451.013902:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768256 00000100:00100000:0.0:1788448451.013986:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:0.0:1788448451.013999:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768256:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448451.014107:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768256:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 111us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448451.014116:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00080000:0.0:1788448451.014149:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448451.014211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448451.017910:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768384 00000100:00100000:1.0:1788448451.017931:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768384 00000100:00100000:1.0:1788448451.018019:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768512 00000100:00100000:1.0:1788448451.018036:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768512 00000100:00100000:1.0:1788448451.018074:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448451.018088:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768384:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448451.018208:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768384:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 101us (5359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448451.018229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448451.018253:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:1.0:1788448451.018260:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768512:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448451.018286:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768512:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448451.018293:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00080000:0.0:1788448451.018417:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448451.018422:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448451.105317:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448452.128399:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448452.198996:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926918784:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448452.199099:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448452.200498:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918784 00000100:00100000:3.0:1788448452.200514:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918784 00000100:00100000:3.0:1788448452.200589:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788448452.200599:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926918784:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448452.200640:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448452.200818:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926918784:12345-0@lo:13:osp-pre-0-0.0 Request processed in 219us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448452.200826:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1788448452.200851:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788448452.200858:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b1500 x1875323926918784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448468 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448452.200880:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926918784:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448453.156464:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448454.185410:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448454.240445:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926919040:0@lo:400:kworker.0 00000100:00100000:2.0:1788448454.240494:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926918912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.240518:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448454.240530:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.240567:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926919552:0@lo:400:kworker.0 00000100:00100000:2.0:1788448454.248552:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919040 00000100:00100000:2.0:1788448454.248565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919040 00000100:00100000:2.0:1788448454.248630:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448454.248640:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926919040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448454.249170:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926919040:12345-0@lo:400:kworker.0 Request processed in 531us (8650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448454.249180:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448454.249249:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926919296:0@lo:400:kworker.0 00000100:00100000:2.0:1788448454.249310:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448454.249360:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448454.249367:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926919168:0@lo:400:kworker.0 00000100:00100000:2.0:1788448454.249393:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448454.249509:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919296 00000100:00100000:1.0:1788448454.249515:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919296 00000100:00100000:1.0:1788448454.249563:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448454.249571:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926919296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.249612:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926919296:12345-0@lo:400:kworker.0 Request processed in 43us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.249618:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1788448454.249635:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448454.251580:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926919424:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.251736:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926918912 00000100:00100000:3.0:1788448454.251744:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926918912 00000100:00100000:3.0:1788448454.251803:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788448454.251814:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926918912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.252053:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926918912:12345-0@lo:400:kworker.0 Request processed in 241us (11520us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448454.252060:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788448454.252686:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.252748:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926919040:0@lo:400:kworker.0 00000100:00100000:1.0:1788448454.252802:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919552 00000100:00100000:1.0:1788448454.252808:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919552 00000100:00100000:1.0:1788448454.252855:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448454.252871:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926919552:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788448454.252872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448454.252925:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926919552:12345-0@lo:400:kworker.0 Request processed in 55us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448454.252932:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1788448454.252953:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b0000 x1875323926919552/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448454.252964:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926919552:0@lo:400:kworker.0 00010000:00080000:2.0:1788448454.254313:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b3100 x1875323926919296/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448454.254330:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926919296:0@lo:400:kworker.0 00000100:00100000:0.0:1788448454.254899:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919168 00000100:00100000:0.0:1788448454.254908:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919168 00000100:00100000:0.0:1788448454.254970:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448454.254980:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926919168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448454.255052:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926919168:12345-0@lo:400:kworker.0 Request processed in 73us (5658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448454.255059:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1788448454.255161:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448454.255558:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926919168:0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.257161:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448454.257234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919424 00000100:00100000:0.0:1788448454.257243:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919424 00000100:00100000:3.0:1788448454.257261:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926918912:0@lo:400:kworker.0 00000100:00100000:0.0:1788448454.257310:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788448454.257318:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926919424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448454.257509:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926919424:0@lo:400:kworker.0 00000100:00100000:0.0:1788448454.257898:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926919424:12345-0@lo:400:kworker.0 Request processed in 85us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448454.257908:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1788448454.257942:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448454.754044:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926919680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448454.754123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448454.754300:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919680 00000100:00100000:3.0:1788448454.754309:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919680 00000100:00100000:3.0:1788448454.754360:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788448454.754370:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926919680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448454.754408:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448454.754469:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926919680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448454.754475:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1788448454.754553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc12d80 x1875323926919680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448454.754573:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926919680:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788448455.201962:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448456.116763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448456.117006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448456.117037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448456.117060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448456.117082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448456.117105:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768896 00000100:00100000:1.0:1788448456.117114:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768896 00000100:00100000:1.0:1788448456.117181:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768768 00000100:00100000:3.0:1788448456.117389:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:3.0:1788448456.117402:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768896:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448456.117496:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902768896:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 97us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448456.117504:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:1.0:1788448456.117718:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768768 00000100:00100000:1.0:1788448456.117749:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1788448456.117756:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902768768:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448456.117790:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902768768:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 35us (753us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.117797:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1788448456.117816:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769024 00000100:00100000:1.0:1788448456.117819:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769024 00000100:00100000:1.0:1788448456.117841:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769152 00000100:00100000:1.0:1788448456.117844:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769152 00000100:00100000:1.0:1788448456.117861:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448456.117867:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2351:x1875323902769024:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:1.0:1788448456.117887:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aaf21 00000100:00080000:1.0:1788448456.117895:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a835b9f000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448456.117944:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788448456.118556:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+2:2351:x1875323902769024:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 684us (1491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.118565:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448456.118582:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1788448456.118590:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2351:x1875323902769152:12345-192.168.204.37@tcp:9:kworker.0 00000020:00000080:1.0:1788448456.118605:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aaf28 00000100:00080000:1.0:1788448456.118611:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a835b9e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788448456.118636:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1788448456.118811:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+2:2351:x1875323902769152:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 221us (1727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448456.118817:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00080000:1.0:1788448456.118840:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448456.118844:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448456.118847:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448456.118947:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448456.118953:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448456.120581:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902768640 00000100:00100000:2.0:1788448456.120595:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902768640 00000100:00100000:2.0:1788448456.120660:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 226 00000100:00100000:2.0:1788448456.120675:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902768640:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448456.120805:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902768640:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 135us (4050us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448456.120824:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 226 00010000:00010000:2.0:1788448456.228576:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448457.248450:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448457.312863:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448457.312890:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926919808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448457.312963:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448457.313214:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919808 00000100:00100000:3.0:1788448457.313222:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919808 00000100:00100000:3.0:1788448457.313323:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788448457.313333:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926919808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448457.313384:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448457.313434:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926919808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448457.313441:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:2.0:1788448457.313537:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b0380 x1875323926919808/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448473 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448457.313559:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926919808:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448457.313831:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1788448457.389111:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000020:00000080:0.0:1788448457.389121:0:7637:0:(genops.c:885:class_export_put()) final put ffff99a835b9b800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000020:00000080:0.0:1788448457.389154:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a835b9b800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 for lustre-OST0001 00000020:00000080:0.0:1788448457.389222:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a835b9e000 for lustre-OST0001 00010000:00010000:2.0:1788448458.274662:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448459.296444:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448459.362021:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926920320:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.362129:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.362238:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448459.362245:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926920192:0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.362274:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448459.362323:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920320 00000100:00100000:2.0:1788448459.362333:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920320 00000100:00100000:2.0:1788448459.362404:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448459.362415:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926920320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448459.362477:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926920320:12345-0@lo:400:kworker.0 Request processed in 64us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448459.362484:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788448459.362510:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788448459.362544:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b3480 x1875323926920320/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448459.362595:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926920320:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.362870:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926920064:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.362909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.362940:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926920576:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.362963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.362990:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788448459.362997:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926919936:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363029:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.363050:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926920448:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363084:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.363113:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920576 00000100:00100000:0.0:1788448459.363118:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920576 00000100:00100000:0.0:1788448459.363159:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448459.363167:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926920576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363238:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926920576:12345-0@lo:400:kworker.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.363245:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448459.363268:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920192 00000100:00100000:0.0:1788448459.363271:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920192 00000100:00100000:0.0:1788448459.363300:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920064 00000100:00100000:0.0:1788448459.363303:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920064 00000100:00100000:0.0:1788448459.363329:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920448 00000100:00100000:0.0:1788448459.363332:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920448 00000100:00100000:0.0:1788448459.363362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788448459.363368:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926920192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363407:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926920192:12345-0@lo:400:kworker.0 Request processed in 39us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.363412:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788448459.363423:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448459.363429:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926920064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363455:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926920064:12345-0@lo:400:kworker.0 Request processed in 27us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.363459:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788448459.363469:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788448459.363475:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926920448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363495:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926920448:12345-0@lo:400:kworker.0 Request processed in 21us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.363500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1788448459.363517:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448459.363521:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448459.363546:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926920448:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363557:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926920064:0@lo:400:kworker.0 00010000:00080000:0.0:1788448459.363582:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b1c00 x1875323926920576/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448475 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448459.363591:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926920576:0@lo:400:kworker.0 00000100:00100000:0.0:1788448459.363620:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926920192:0@lo:400:kworker.0 00000100:00100000:3.0:1788448459.363988:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926919936 00000100:00100000:3.0:1788448459.363994:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926919936 00000100:00100000:3.0:1788448459.364032:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788448459.364039:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926919936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448459.364175:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926919936:12345-0@lo:400:kworker.0 Request processed in 136us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448459.364214:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1788448459.365033:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926919936:0@lo:400:kworker.0 00000001:02000400:2.0:1788448459.659931:0:11009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788448459.874542:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448459.874584:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926920704:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448459.874682:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448459.874994:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920704 00000100:00100000:0.0:1788448459.875004:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920704 00000100:00100000:0.0:1788448459.875115:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448459.875128:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926920704:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448459.875179:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448459.875270:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926920704:12345-0@lo:13:osp-pre-1-0.0 Request processed in 144us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448459.875278:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1788448459.888058:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83fc12d80 x1875323926920704/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448459.888102:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926920704:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448460.325564:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788448460.489874:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000020:00000080:2.0:1788448460.489884:0:6707:0:(genops.c:885:class_export_put()) final put ffff99a835b99800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000020:00000080:1.0:1788448460.490268:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a835b99800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 for lustre-OST0000 00000020:00000080:1.0:1788448460.490330:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a835b9f000 for lustre-OST0000 00000100:00100000:0.0:1788448461.237373:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448461.237411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448461.237457:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448461.237489:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769536 00000100:00100000:0.0:1788448461.237498:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769536 00000100:00100000:0.0:1788448461.237551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769408 00000100:00100000:0.0:1788448461.237555:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769408 00000100:00100000:0.0:1788448461.237580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:0.0:1788448461.237589:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2354:x1875323902769536:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448461.237662:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2354:x1875323902769536:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (249us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.237668:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:0.0:1788448461.237685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:0.0:1788448461.237691:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902769408:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448461.237715:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902769408:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (258us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448461.237732:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00080000:0.0:1788448461.237763:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448461.238474:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769280 00000100:00100000:2.0:1788448461.238482:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769280 00000100:00100000:2.0:1788448461.238526:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 228 00000100:00100000:2.0:1788448461.238535:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2354:x1875323902769280:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448461.239040:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2354:x1875323902769280:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 504us (1674us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448461.239048:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 228 00010000:00010000:2.0:1788448461.348899:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448462.368421:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448462.432438:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448462.432464:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926920832:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448462.432543:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448462.432955:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926920832 00000100:00100000:0.0:1788448462.432965:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926920832 00000100:00100000:0.0:1788448462.433062:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448462.433072:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926920832:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788448462.433099:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1788448462.433109:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448462.433211:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926920832:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448462.433219:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1788448462.433293:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b1180 x1875323926920832/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448478 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448462.433314:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926920832:0@lo:13:osp-pre-0-0.0 00000020:00000080:0.0:1788448463.137044:0:11157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdd67b9a80 20000000:00000080:0.0:1788448463.137063:0:11157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a83e5f0800 uarg=0000000000000000 20000000:01000000:0.0:1788448463.137097:0:11157:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448463.137102:0:11157:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1788448463.137106:0:11157:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1788448463.138608:0:11158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1788448463.138805:0:11157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788448463.147491:0:11157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448463.147524:0:11157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147542:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147549:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147556:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147583:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147590:0:11157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147598:0:11157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147765:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147782:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 12 pid: 5829 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.147797:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835423480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926920960:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448463.147969:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.147977:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 12 pid: 5830 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.147986:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835420700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921088:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448463.148021:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.148030:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 18 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.148051:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921216:0@lo:104: 00000100:00100000:0.0:1788448463.148086:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448463.148116:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.148143:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 18 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.148152:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921344:0@lo:104: 00000100:00100000:0.0:1788448463.148175:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448463.148439:0:11157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.148448:0:11157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 18 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.148457:0:11157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921472:0@lo:104: 00000100:00100000:0.0:1788448463.148478:0:11157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448463.148488:0:11157:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b180 going to sleep for 11 seconds 00000100:00100000:2.0:1788448463.148929:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921216 00000100:00100000:2.0:1788448463.148937:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921216 00000100:00100000:2.0:1788448463.148973:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921344 00000100:00100000:2.0:1788448463.148977:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921344 00000100:00100000:2.0:1788448463.148986:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921472 00000100:00100000:2.0:1788448463.148988:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921472 00000100:00100000:2.0:1788448463.149001:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448463.149010:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:11157:x1875323926921216:12345-0@lo:104: 00010000:00010000:2.0:1788448463.149030:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.149180:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448463.149229:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:11157:x1875323926921216:12345-0@lo:104: Request processed in 220us (1141us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448463.149237:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448463.149255:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448463.149262:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:11157:x1875323926921344:12345-0@lo:104: 00010000:00010000:2.0:1788448463.149270:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.149495:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921216:0@lo:104: 00000100:00100000:0.0:1788448463.149504:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921344:0@lo:104: 00010000:00010000:3.0:1788448463.149779:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448463.149787:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.149796:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448463.149800:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.149809:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448463.149817:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448463.149834:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448463.149864:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.149871:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788448463.149920:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926921600:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448463.149956:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788448463.150009:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.150018:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809247200/0xd0e9b344b90aaef0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaef7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.150079:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448463.150083:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.150089:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448463.150091:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.150098:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448463.150104:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448463.150109:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448463.150396:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.150404:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448463.150461:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1788448463.150468:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:11157:x1875323926921344:12345-0@lo:104: Request processed in 1207us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448463.150475:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788448463.150498:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788448463.150507:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:11157:x1875323926921472:12345-0@lo:104: 00010000:00010000:2.0:1788448463.150516:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.150556:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788448463.150561:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:11157:x1875323926921472:12345-0@lo:104: Request processed in 57us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448463.150566:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1788448463.150583:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1788448463.150674:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926921728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448463.150704:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788448463.150748:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448463.150750:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921600 00000100:00100000:1.0:1788448463.150756:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921600 00010000:00010000:2.0:1788448463.150758:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.150764:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448463.150767:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.150774:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448463.150777:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 19 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448463.150781:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448463.150786:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:1.0:1788448463.150795:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921728 00000100:00100000:1.0:1788448463.150798:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921728 00010000:00010000:2.0:1788448463.150806:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448463.150807:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.150812:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788448463.150824:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1788448463.150826:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448463.150830:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804617450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3309:x1875323926921600:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448463.150833:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90aaed4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaedb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448463.150840:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448463.150843:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.150844:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448463.150845:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.150846:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448463.150854:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.150855:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926921856:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448463.150869:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810628600/0xd0e9b344b90aaef7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaef0 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.150881:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448463.150882:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448463.150902:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.150904:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448463.152352:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921856 00000100:00100000:2.0:1788448463.152365:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921856 00010000:00010000:2.0:1788448463.152407:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.152435:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448463.152444:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3310:x1875323926921728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448463.152459:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448463.152465:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.152474:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.152488:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629800/0xd0e9b344b90aaee9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaee2 expref: 20 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.152501:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448463.152570:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926921728:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (1864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448463.152577:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448463.152593:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448463.152600:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3311:x1875323926921856:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448463.152608:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448463.152622:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 18 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.152631:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 18 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.152657:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448463.153296:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3311:x1875323926921856:12345-0@lo:103:ldlm_bl.0 Request processed in 695us (2411us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448463.153305:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448463.153361:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926921856:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448463.153633:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448463.153644:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaee2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaee9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.154909:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.154914:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.154917:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448463.156362:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247800/0xd0e9b344b90aaedb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaed4 expref: 17 pid: 5830 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.156384:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921472:0@lo:104: 00000100:00100000:3.0:1788448463.156806:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835423480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926920960:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448463.156921:0:11157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835420700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11157:1875323926921088:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448463.156953:0:11157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.157481:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926921600:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448463.157485:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804617450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3309:x1875323926921600:12345-0@lo:103:ldlm_bl.0 Request processed in 6653us (7527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448463.157497:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448463.157583:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926921728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448463.161214:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448463.161257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448463.161324:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769664 00000100:00100000:0.0:1788448463.161330:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769792 00000100:00100000:2.0:1788448463.161334:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769664 00000100:00100000:0.0:1788448463.161334:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769792 00010000:00010000:2.0:1788448463.161372:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 14 pid: 5829 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.161373:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 14 pid: 5830 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.161411:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:0.0:1788448463.161417:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:2.0:1788448463.161420:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+14:2352:x1875323902769664:12345-192.168.204.37@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788448463.161423:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:188c2354-2939-43ce-85d0-cb78875d8855+14:2352:x1875323902769792:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448463.161433:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448463.161433:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448463.161439:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 14 pid: 5829 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.161439:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 14 pid: 5830 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.161451:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 14 pid: 5829 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.162900:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 14 pid: 5830 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.162928:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaefe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051092b expref: 14 pid: 5830 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.162945:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448463.162978:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629400/0xd0e9b344b90aaf13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510963 expref: 13 pid: 5829 timeout: 423 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.163136:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:188c2354-2939-43ce-85d0-cb78875d8855+12:2352:x1875323902769792:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 1701us (1866us total) trans 0 rc 0/0 00010000:00010000:2.0:1788448463.163141:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448463.163149:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00010000:00010000:2.0:1788448463.163156:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163175:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163183:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163205:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163212:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163218:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448463.163222:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163230:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163388:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448463.163400:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448463.163424:0:11157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.163428:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+11:2352:x1875323902769664:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2008us (2251us total) trans 0 rc 0/0 00010000:00010000:0.0:1788448463.163435:0:11157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448463.163449:0:11157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90aaf2f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448463.163453:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00010000:00010000:2.0:1788448463.394637:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448464.419319:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448464.480387:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926922112:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.480458:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.480703:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926922624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.480751:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.480786:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448464.480793:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926922240:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.480817:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.480849:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922112 00000100:00100000:2.0:1788448464.480856:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922112 00000100:00100000:2.0:1788448464.480896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922240 00000100:00100000:2.0:1788448464.480899:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922240 00000100:00100000:2.0:1788448464.480928:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448464.480936:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926922112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.480991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926922112:12345-0@lo:400:kworker.0 Request processed in 55us (532us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.480997:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448464.481014:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448464.481019:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926922240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.481046:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926922240:12345-0@lo:400:kworker.0 Request processed in 28us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.481051:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788448464.481068:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922624 00000100:00100000:2.0:1788448464.481071:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922624 00000100:00100000:2.0:1788448464.481119:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448464.481125:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926922624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.481156:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926922624:12345-0@lo:400:kworker.0 Request processed in 31us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.481162:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1788448464.481181:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448464.481209:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448464.481247:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926922240:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.481257:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926922112:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481390:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926921984:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481440:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448464.481466:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926922496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481488:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448464.481521:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448464.481527:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926922368:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481550:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448464.481585:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922368 00000100:00100000:0.0:1788448464.481589:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922368 00000100:00100000:0.0:1788448464.481621:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788448464.481627:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926922368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481662:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926922368:12345-0@lo:400:kworker.0 Request processed in 36us (112us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.481668:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:0.0:1788448464.481695:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b0e00 x1875323926922368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448464.481706:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926922368:0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481728:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922496 00000100:00100000:0.0:1788448464.481731:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922496 00000100:00100000:0.0:1788448464.481754:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788448464.481759:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926922496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448464.481791:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835420700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926922496:12345-0@lo:400:kworker.0 Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.481797:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788448464.481821:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926922496:0@lo:400:kworker.0 00010000:00080000:2.0:1788448464.483605:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b1180 x1875323926922624/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448464.483636:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926922624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.483683:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926921984 00000100:00100000:2.0:1788448464.483690:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926921984 00000100:00100000:2.0:1788448464.483733:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1788448464.483742:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3312:x1875323926921984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448464.483819:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3312:x1875323926921984:12345-0@lo:400:kworker.0 Request processed in 77us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.483826:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:2.0:1788448464.483865:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448464.483872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448464.484564:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926921984:0@lo:400:kworker.0 10000000:01000000:2.0:1788448464.610749:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448464.610760:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80888c000 from 7 10000000:01000000:2.0:1788448464.610767:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448464.610829:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.610865:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.610883:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448464.610920:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926922752:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.611002:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.611067:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448464.611637:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922752 00000100:00100000:1.0:1788448464.611648:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922752 00000100:00100000:1.0:1788448464.611712:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1788448464.611724:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926922752:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448464.611740:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448464.611759:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaf36 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.611791:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.611803:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.611813:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d600, rc 0) 00000100:00100000:1.0:1788448464.611924:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926922752:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.611931:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:3.0:1788448464.612585:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926922752:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448464.612605:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.612616:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448464.612805:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926922880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.612846:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.612927:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448464.612964:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926922880 00000100:00100000:0.0:1788448464.612983:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926922880 00000100:00100000:0.0:1788448464.613052:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788448464.613064:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926922880:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448464.613544:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926922880:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 482us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.613551:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:3.0:1788448464.614238:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926922880:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.614393:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923008:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.614448:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.614588:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448464.614648:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923008 00000100:00100000:0.0:1788448464.614653:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923008 00000100:00100000:0.0:1788448464.614705:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788448464.614715:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926923008:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448464.615014:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926923008:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.615022:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1788448464.615114:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923008:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788448464.616979:0:11189:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788448464.617219:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788448464.617240:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448464.617252:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.617264:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448464.617275:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448464.617278:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a8092e0800 from 7 10000000:01000000:3.0:1788448464.617280:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448464.617330:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.617339:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.617350:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448464.617374:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.617434:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.617472:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250480 going to sleep for 11 seconds 00000100:00100000:0.0:1788448464.617654:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923136 00000100:00100000:0.0:1788448464.617672:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923136 00000100:00100000:0.0:1788448464.617857:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788448464.617868:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926923136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448464.617882:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448464.617896:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaf44 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.617918:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.617929:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.617939:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed800, rc 0) 00000100:00100000:0.0:1788448464.617998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.618005:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1788448464.618150:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448464.618168:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.618177:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448464.618864:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.618902:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448464.618939:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448464.619039:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923264 00000100:00100000:2.0:1788448464.619045:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923264 00000100:00100000:2.0:1788448464.619086:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788448464.619105:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923264:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.619899:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923264:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 801us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.619908:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:2.0:1788448464.619996:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923264:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.620036:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923392:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.620079:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.620155:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448464.620609:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923392 00000100:00100000:0.0:1788448464.620617:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923392 00000100:00100000:0.0:1788448464.620665:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788448464.620676:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923392:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448464.621010:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923392:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 336us (930us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.621017:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1788448464.621083:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923392:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788448464.622476:0:11190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788448464.622864:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788448464.622886:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448464.622898:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.622910:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448464.622942:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448464.622944:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80badd000 from 7 10000000:01000000:2.0:1788448464.622947:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448464.622985:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.622993:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.623004:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448464.623026:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.623078:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.623156:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448464.623395:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923520 00000100:00100000:3.0:1788448464.623402:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923520 00000100:00100000:3.0:1788448464.623471:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788448464.623480:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926923520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448464.623492:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448464.623567:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90aaf52 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.623590:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.623601:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448464.623610:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247200, rc 0) 00000100:00100000:3.0:1788448464.623651:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926923520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.623657:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1788448464.623734:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448464.623748:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448464.623757:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448464.623802:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.623823:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.623949:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448464.624006:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923648 00000100:00100000:1.0:1788448464.624010:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923648 00000100:00100000:1.0:1788448464.624030:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788448464.624036:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926923648:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448464.624322:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926923648:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 285us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.624329:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788448464.624397:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923648:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.624423:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923776:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.624458:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448464.624481:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448464.624577:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923776 00000100:00100000:1.0:1788448464.624586:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923776 00000100:00100000:1.0:1788448464.624604:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1788448464.624609:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926923776:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448464.624743:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926923776:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 132us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.624749:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788448464.625117:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926923776:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788448464.626167:0:11191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1788448464.626428:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1788448464.626445:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448464.626455:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.626466:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448464.819456:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448464.819701:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902769920 00000100:00100000:1.0:1788448464.819712:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902769920 00000100:00100000:1.0:1788448464.819771:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:1.0:1788448464.819781:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+11:5593:x1875323902769920:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448464.819798:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448464.819816:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba051098d expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.819844:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.819855:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448464.819865:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c800, rc 0) 00000100:00100000:1.0:1788448464.819944:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902769920:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 164us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448464.819951:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:1.0:1788448464.827667:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448464.827823:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770048 00000100:00100000:0.0:1788448464.827834:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770048 00000100:00100000:0.0:1788448464.827887:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 240 00000100:00100000:0.0:1788448464.827898:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902770048:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448464.828721:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902770048:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 822us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.828731:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 240 00000100:00100000:0.0:1788448464.837340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448464.837433:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770176 00000100:00100000:3.0:1788448464.837450:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770176 00000100:00100000:3.0:1788448464.837508:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:3.0:1788448464.837519:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902770176:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448464.837749:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902770176:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 230us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448464.837757:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:3.0:1788448464.842425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448464.843153:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770304 00000100:00100000:0.0:1788448464.843164:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770304 00000100:00100000:0.0:1788448464.843254:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 242 00000100:00100000:0.0:1788448464.843272:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902770304:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448464.843291:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448464.843310:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510994 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.843340:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.843366:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 13 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448464.843375:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:0.0:1788448464.843431:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902770304:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 161us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.846658:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 242 00000100:00100000:3.0:1788448464.849378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448464.849451:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770432 00000100:00100000:2.0:1788448464.849462:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770432 00000100:00100000:2.0:1788448464.849519:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 243 00000100:00100000:2.0:1788448464.849529:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902770432:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448464.849836:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902770432:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 306us (465us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448464.849845:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 243 00000100:00100000:3.0:1788448464.851783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448464.851923:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770560 00000100:00100000:0.0:1788448464.851934:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770560 00000100:00100000:0.0:1788448464.852000:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 244 00000100:00100000:0.0:1788448464.852010:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902770560:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448464.852274:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902770560:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 265us (496us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.852282:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 244 00000100:00100000:3.0:1788448464.992958:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448464.993006:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926923904:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448464.993148:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448464.993424:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926923904 00000100:00100000:0.0:1788448464.993434:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926923904 00000100:00100000:0.0:1788448464.993678:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448464.993689:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926923904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448464.993730:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448464.993780:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926923904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448464.993786:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:1.0:1788448464.993991:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835422680 x1875323926923904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448464.994011:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835422680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926923904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448465.440617:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448466.359304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448466.359345:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448466.359371:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448466.359403:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770688 00000100:00100000:3.0:1788448466.359412:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770688 00000100:00100000:3.0:1788448466.359463:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 245 00000100:00100000:3.0:1788448466.359472:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902770688:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448466.359546:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902770688:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448466.359553:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 245 00000100:00100000:3.0:1788448466.359590:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770944 00000100:00100000:3.0:1788448466.359594:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770944 00000100:00100000:3.0:1788448466.359634:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902770816 00000100:00100000:3.0:1788448466.359637:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902770816 00000100:00100000:3.0:1788448466.359670:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:3.0:1788448466.359676:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902770944:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448466.359712:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902770944:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 36us (366us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448466.359718:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:3.0:1788448466.359731:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:3.0:1788448466.359737:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902770816:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448466.359759:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902770816:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 23us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448466.359765:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00080000:3.0:1788448466.360737:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448466.464508:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788448467.111452:0:11356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1788448467.488675:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448467.552764:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926924032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448467.552876:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448467.553260:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924032 00000100:00100000:3.0:1788448467.553273:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924032 00000100:00100000:3.0:1788448467.553418:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448467.553431:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926924032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448467.553478:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448467.553549:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926924032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448467.553557:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1788448467.554307:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b1880 x1875323926924032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448483 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448467.554349:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926924032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448467.554419:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448468.512477:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448469.536456:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448469.602227:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926924416:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602282:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926924160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.602305:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448469.602317:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448469.602368:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926924672:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602390:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.602412:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926924288:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602414:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448469.602419:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926924544:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602439:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448469.602439:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448469.602456:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926924800:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602472:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924160 00000100:00100000:1.0:1788448469.602475:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448469.602480:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924160 00000100:00100000:1.0:1788448469.602502:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924416 00000100:00100000:1.0:1788448469.602505:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924416 00000100:00100000:0.0:1788448469.602523:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788448469.602531:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926924160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602538:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924672 00000100:00100000:1.0:1788448469.602540:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924672 00000100:00100000:1.0:1788448469.602552:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924288 00000100:00100000:1.0:1788448469.602554:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924288 00000100:00100000:1.0:1788448469.602579:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448469.602580:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926924160:12345-0@lo:400:kworker.0 Request processed in 49us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.602585:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926924416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602586:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788448469.602616:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926924416:12345-0@lo:400:kworker.0 Request processed in 32us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.602620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788448469.602625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788448469.602628:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926924672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602636:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788448469.602641:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602652:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835422300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926924672:12345-0@lo:400:kworker.0 Request processed in 26us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.602657:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788448469.602673:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924544 00000100:00100000:0.0:1788448469.602676:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924544 00000100:00100000:1.0:1788448469.602684:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926924288:12345-0@lo:400:kworker.0 Request processed in 42us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448469.602690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788448469.602701:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924800 00000100:00100000:0.0:1788448469.602704:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924800 00000100:00100000:0.0:1788448469.602719:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448469.602724:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926924544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602741:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926924288:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602761:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835422d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926924544:12345-0@lo:400:kworker.0 Request processed in 36us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.602767:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448469.602777:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448469.602782:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926924800:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788448469.602798:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448469.602802:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448469.602805:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448469.602810:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926924800:12345-0@lo:400:kworker.0 Request processed in 28us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448469.602816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788448469.602827:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a80868c700 x1875323926924544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:0.0:1788448469.602834:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a80868df80 x1875323926924800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448485 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448469.602838:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926924544:0@lo:400:kworker.0 00000100:00100000:0.0:1788448469.602843:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926924800:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602846:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926924160:0@lo:400:kworker.0 00000100:00100000:1.0:1788448469.602854:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926924672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448469.606875:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926924416:0@lo:400:kworker.0 00000100:00100000:1.0:1788448470.112485:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926924928:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448470.112562:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448470.112646:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926924928 00000100:00100000:1.0:1788448470.112654:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926924928 00000100:00100000:1.0:1788448470.112714:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788448470.112723:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926924928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448470.112752:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448470.113171:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926924928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 448us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448470.113181:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1788448470.115899:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a807974380 x1875323926924928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448486 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448470.115933:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926924928:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1788448470.465075:0:11457:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 11:14:27 (1788448467) === 00010000:00010000:1.0:1788448470.560357:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448470.802285:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448470.802348:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448470.803164:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771200 00000100:00100000:1.0:1788448470.803232:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771200 00000100:00080000:2.0:1788448470.803394:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448470.803464:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1788448470.803478:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:af250c24-64ec-487b-a1ec-11a62017775a+6:9676:x1875323902771200:12345-192.168.204.37@tcp:700:mkdir.0 00000100:00100000:1.0:1788448470.803579:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:af250c24-64ec-487b-a1ec-11a62017775a+6:9676:x1875323902771200:12345-192.168.204.37@tcp:700:mkdir.0 Request processed in 106us (1230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448470.803587:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448470.803873:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771072 00000100:00100000:0.0:1788448470.803878:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771072 00000100:00100000:0.0:1788448470.803916:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:0.0:1788448470.803924:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902771072:12345-192.168.204.37@tcp:41:mkdir.0 00000004:00000024:0.0:1788448470.804418:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788448470.804490:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902771072:12345-192.168.204.37@tcp:41:mkdir.0 Request processed in 566us (2215us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448470.804498:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:0.0:1788448470.814945:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448470.816692:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771456 00000100:00100000:1.0:1788448470.816705:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771456 00000100:00100000:1.0:1788448470.816780:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1788448470.816791:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:9676:x1875323902771456:12345-192.168.204.37@tcp:36:mkdir.0 00010000:00010000:1.0:1788448470.817220:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448470.817251:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90aae4f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510916 expref: 6 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817272:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:1.0:1788448470.817282:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448470.817725:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817739:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817748:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817776:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817784:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.817797:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448470.825702:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788448470.825720:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825734:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825741:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825747:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448470.825753:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825760:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825778:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448470.825782:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448470.825787:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.825794:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90aaf6e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448470.825814:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000048478864 reply state 0000000083bceb8c transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448470.825837:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448470.827353:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835422680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:9676:x1875323902771456:12345-192.168.204.37@tcp:36:mkdir.0 Request processed in 10553us (13264us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788448470.827366:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00010000:00010000:2.0:1788448470.831298:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831315:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831323:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831329:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9da00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448470.831333:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831340:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831358:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a808bbfc00) 00010000:00010000:2.0:1788448470.831362:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448470.831366:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448470.831372:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90aaf75 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448470.846469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448470.850898:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771584 00000100:00100000:3.0:1788448470.850915:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771584 00000100:00100000:3.0:1788448470.851054:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1788448470.851067:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:9677:x1875323902771584:12345-192.168.204.37@tcp:101:chmod.0 00010000:00010000:3.0:1788448470.851091:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448470.851121:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aaf7c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba051099b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851256:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851270:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851283:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448470.851319:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448470.851323:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448470.851373:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851402:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aaf7c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051099b expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851423:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051099b expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.851432:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448470.851435:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448470.851439:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247e00, rc 0) 00000100:00100000:3.0:1788448470.851505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:9677:x1875323902771584:12345-192.168.204.37@tcp:101:chmod.0 Request processed in 442us (5046us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448470.851524:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448470.855269:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448470.855450:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771840 00000100:00100000:3.0:1788448470.855460:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771840 00000100:00100000:3.0:1788448470.855538:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:3.0:1788448470.855549:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:9677:x1875323902771840:12345-192.168.204.37@tcp:36:chmod.0 00010000:00010000:3.0:1788448470.855603:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448470.855641:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf83 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051099b expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.855661:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448470.855674:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448470.855708:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.855722:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.855732:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448470.856046:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f51e6b90 reply state 000000002ec1b2bd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448470.856057:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788448470.856065:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788448470.856163:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:9677:x1875323902771840:12345-192.168.204.37@tcp:36:chmod.0 Request processed in 615us (904us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1788448470.856171:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00010000:00010000:0.0:1788448470.858388:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858404:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858421:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858427:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448470.858431:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858440:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858465:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674400) 00010000:00010000:0.0:1788448470.858469:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448470.858473:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.858479:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90aaf8a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448470.897740:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448470.899522:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902771968 00000100:00100000:0.0:1788448470.899536:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902771968 00000100:00100000:0.0:1788448470.899605:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:0.0:1788448470.899616:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:9678:x1875323902771968:12345-192.168.204.37@tcp:101:chown.0 00010000:00010000:0.0:1788448470.899646:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448470.899672:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aaf91 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109a2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899759:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899773:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448470.899836:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788448470.899840:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448470.899881:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899908:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aaf91 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a2 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899928:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a2 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.899937:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448470.899941:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448470.899943:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec600, rc 0) 00000100:00100000:0.0:1788448470.900033:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:9678:x1875323902771968:12345-192.168.204.37@tcp:101:chown.0 Request processed in 418us (2301us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448470.900040:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1788448470.906956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448470.908710:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902772096 00000100:00100000:3.0:1788448470.908725:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902772096 00000100:00100000:3.0:1788448470.908796:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1788448470.908808:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:9678:x1875323902772096:12345-192.168.204.37@tcp:101:chown.0 00010000:00010000:3.0:1788448470.908848:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448470.908871:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf9f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109a9 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.908947:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.908962:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.908985:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909002:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909010:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909017:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909118:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909126:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.909133:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448470.909930:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448470.909948:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448470.909988:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910004:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910010:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910018:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910024:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448470.910028:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910035:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910049:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448470.910053:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448470.910057:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910064:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafa6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910080:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910086:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910103:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910108:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448470.910110:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910117:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910125:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a829674000) 00010000:00010000:3.0:1788448470.910128:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448470.910131:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910137:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910594:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aaf9f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a9 expref: 10 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910612:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a9 expref: 9 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448470.910620:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a829674a00) 00010000:00010000:3.0:1788448470.910622:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448470.910624:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247a00, rc 0) 00000100:00100000:3.0:1788448470.910715:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:9678:x1875323902772096:12345-192.168.204.37@tcp:101:chown.0 Request processed in 1907us (3766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448470.910735:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1788448470.914695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448470.914780:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902772352 00000100:00100000:0.0:1788448470.914791:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902772352 00000100:00100000:0.0:1788448470.914853:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:0.0:1788448470.914865:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:9678:x1875323902772352:12345-192.168.204.37@tcp:36:chown.0 00010000:00010000:0.0:1788448470.914928:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448470.914959:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90aafb4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a9 expref: 9 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.915016:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a829674a00) 00010000:00010000:0.0:1788448470.915031:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448470.915060:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.915073:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448470.915083:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448470.971667:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:3.0:1788448470.973575:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f5ba083 reply state 00000000c51e51c2 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448470.973594:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788448470.973613:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00080000:3.0:1788448470.973741:0:5837:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:3.0:1788448470.973765:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:9678:x1875323902772352:12345-192.168.204.37@tcp:36:chown.0 Request processed in 58898us (59080us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788448470.973774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00010000:00010000:1.0:1788448470.973920:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.973930:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.973938:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.973944:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448470.973949:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.973957:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.973987:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448470.973990:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788448470.973995:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448470.974001:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aafbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448471.001777:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.002643:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902772480 00000100:00100000:3.0:1788448471.002661:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902772480 00000100:00100000:3.0:1788448471.002748:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448471.002762:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:9679:x1875323902772480:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:3.0:1788448471.002801:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448471.002963:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aafc2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109b0 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448471.004477:0:7154:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1432us 00010000:00010000:3.0:1788448471.025729:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.025751:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.025763:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.025780:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.025802:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.025809:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026413:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026424:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026433:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448471.026466:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448471.026470:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448471.026504:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026580:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026587:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026595:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026600:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448471.026605:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026613:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026624:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448471.026627:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448471.026631:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026638:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90aafc9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026649:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026664:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026670:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026675:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448471.026678:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026684:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026692:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a829674600) 00010000:00010000:2.0:1788448471.026695:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448471.026697:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026704:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90aafd0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026746:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90aafc2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b0 expref: 8 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026760:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b0 expref: 7 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.026768:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448471.026770:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788448471.026778:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:2.0:1788448471.026891:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:9679:x1875323902772480:12345-192.168.204.37@tcp:101:touch.500 Request processed in 24132us (25124us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448471.026902:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:2.0:1788448471.035582:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.036340:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902772736 00000100:00100000:1.0:1788448471.036351:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902772736 00000100:00100000:1.0:1788448471.036415:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:1.0:1788448471.036425:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:9679:x1875323902772736:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:1.0:1788448471.036444:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448471.036473:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90aafde lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109b7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036737:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036752:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036764:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036818:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036827:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.036834:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448471.037591:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1788448471.037844:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90aaff3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037854:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90aaff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037862:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90aaff3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037900:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037907:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037914:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037920:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448471.037924:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037932:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037942:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448471.037945:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448471.037949:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.037954:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90aafe5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448471.037989:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044c7f8a5 reply state 0000000049cb1953 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448471.037998:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788448471.038029:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90aafde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b7 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.038043:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90aaff3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.038050:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448471.038052:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448471.038055:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9ca00, rc 0) 00000100:00100000:1.0:1788448471.038119:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:9679:x1875323902772736:12345-192.168.204.37@tcp:101:touch.500 Request processed in 1695us (2546us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788448471.038137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00010000:00010000:1.0:1788448471.041411:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041429:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041436:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041442:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448471.041446:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041481:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041497:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448471.041500:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448471.041505:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.041512:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aafec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448471.043427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.044016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902772992 00000100:00100000:1.0:1788448471.044027:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902772992 00000100:00100000:1.0:1788448471.044091:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1788448471.044104:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:9679:x1875323902772992:12345-192.168.204.37@tcp:36:touch.500 00010000:00010000:1.0:1788448471.044165:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448471.044211:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90aaff3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b7 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.044228:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448471.044238:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448471.044285:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.044299:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.044326:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448471.044594:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009e981870 reply state 00000000a1198e7b transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448471.044605:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448471.044872:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+10:9679:x1875323902772992:12345-192.168.204.37@tcp:36:touch.500 Request processed in 770us (1454us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1788448471.044879:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00010000:00010000:3.0:1788448471.047126:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047150:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047160:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047166:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448471.047172:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047180:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047249:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbfe00) 00010000:00010000:3.0:1788448471.047253:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448471.047259:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.047265:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab001 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448471.049705:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.049795:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902773120 00000100:00100000:1.0:1788448471.049805:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902773120 00000100:00100000:1.0:1788448471.049872:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:1.0:1788448471.049883:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:9679:x1875323902773120:12345-192.168.204.37@tcp:101:touch.500 00010000:00010000:1.0:1788448471.049916:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448471.049944:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab008 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109be expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.050016:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109be expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.050032:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab008 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109be expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.050051:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbf900) 00010000:00010000:1.0:1788448471.050055:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448471.050058:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9ce00, rc 0) 00000100:00100000:1.0:1788448471.050119:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:9679:x1875323902773120:12345-192.168.204.37@tcp:101:touch.500 Request processed in 237us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448471.050127:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:0.0:1788448471.053389:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.053493:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902773248 00000100:00100000:1.0:1788448471.053510:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902773248 00000100:00100000:1.0:1788448471.053571:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448471.053581:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902773248:12345-192.168.204.37@tcp:8:touch.500 00010000:00080000:1.0:1788448471.053620:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:1.0:1788448471.053657:0:6683:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90ab00f 00002000:00100000:1.0:1788448471.053670:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af250c24-64ec-487b-a1ec-11a62017775a/ffff99a80755c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788448471.053704:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788448471.054146:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788448471.054180:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a807558000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448471.054877:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902773248:12345-192.168.204.37@tcp:8:touch.500 Request processed in 1292us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448471.054889:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1788448471.064318:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448471.064736:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902773376 00000100:00100000:0.0:1788448471.064747:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902773376 00000100:00100000:0.0:1788448471.064838:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1788448471.064850:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:0:x1875323902773376:12345-192.168.204.37@tcp:2:touch.500 00000100:00080000:2.0:1788448471.066818:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448471.127355:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:0:x1875323902773376:12345-192.168.204.37@tcp:2:touch.500 Request processed in 62497us (63036us total) trans 4294967299 rc 0/0 00000001:00080000:2.0:1788448471.127478:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:2.0:1788448471.127494:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000100:00100000:0.0:1788448471.127541:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1788448471.133848:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.134210:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902773632 00000100:00100000:1.0:1788448471.134221:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902773632 00000100:00100000:1.0:1788448471.134275:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:1.0:1788448471.134285:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:9679:x1875323902773632:12345-192.168.204.37@tcp:35:touch.500 00000100:00100000:1.0:1788448471.134875:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+11:9679:x1875323902773632:12345-192.168.204.37@tcp:35:touch.500 Request processed in 586us (1042us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788448471.134883:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1788448471.167599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448471.170179:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902773760 00000100:00100000:2.0:1788448471.170258:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902773760 00000100:00100000:3.0:1788448471.170550:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1788448471.170591:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+11:9680:x1875323902773760:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:3.0:1788448471.170620:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448471.170642:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab016 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109c5 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.170872:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.170887:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.170898:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448471.170930:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448471.170933:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448471.170977:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.171246:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab016 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109c5 expref: 13 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.171267:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109c5 expref: 12 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.171276:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448471.171279:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448471.171282:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247c00, rc 0) 00000100:00100000:3.0:1788448471.171467:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+12:9680:x1875323902773760:12345-192.168.204.37@tcp:101:rm.0 Request processed in 878us (3876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448471.171486:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:2.0:1788448471.179672:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.180730:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774016 00000100:00100000:1.0:1788448471.180743:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774016 00000100:00100000:2.0:1788448471.181066:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:2.0:1788448471.181077:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+12:9680:x1875323902774016:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:2.0:1788448471.181108:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448471.181130:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab024 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109cc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448471.181243:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788448471.181410:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab024 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109cc expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.181427:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448471.181430:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448471.181435:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab024 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109cc expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448471.181458:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179200, rc 0) 00000100:00100000:2.0:1788448471.181590:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:9680:x1875323902774016:12345-192.168.204.37@tcp:101:rm.0 Request processed in 514us (1928us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1788448471.181597:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:2.0:1788448471.189002:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.189309:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774144 00000100:00100000:3.0:1788448471.189319:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774144 00000100:00100000:3.0:1788448471.189379:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:3.0:1788448471.189390:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+13:9680:x1875323902774144:12345-192.168.204.37@tcp:37:rm.0 00000100:00100000:1.0:1788448471.195489:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+13:9680:x1875323902774144:12345-192.168.204.37@tcp:37:rm.0 Request processed in 6090us (6497us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448471.195503:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:2.0:1788448471.200032:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.200221:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774400 00000100:00100000:1.0:1788448471.200245:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774400 00000100:00100000:1.0:1788448471.200315:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1788448471.200326:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:9680:x1875323902774400:12345-192.168.204.37@tcp:35:rm.0 00000100:00100000:1.0:1788448471.200560:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace2850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+14:9680:x1875323902774400:12345-192.168.204.37@tcp:35:rm.0 Request processed in 235us (536us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788448471.200567:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1788448471.204055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.204231:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774656 00000100:00100000:1.0:1788448471.204242:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774656 00000100:00100000:1.0:1788448471.204294:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1788448471.204304:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:9680:x1875323902774656:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:1.0:1788448471.204327:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448471.204345:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab032 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109d3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.204439:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab039 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.204453:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.204464:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab039 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448471.204475:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788448471.204660:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab032 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109d3 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.204678:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab039 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109d3 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.204697:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448471.204700:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448471.204704:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c400, rc 0) 00000100:00100000:1.0:1788448471.204766:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902774656:12345-192.168.204.37@tcp:101:rm.0 Request processed in 462us (719us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788448471.204772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:2.0:1788448471.209324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.209554:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774784 00000100:00100000:3.0:1788448471.209566:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774784 00000100:00100000:3.0:1788448471.209623:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:3.0:1788448471.209632:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902774784:12345-192.168.204.37@tcp:41:rm.0 00000004:00000024:3.0:1788448471.209690:0:5837:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1788448471.209767:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902774784:12345-192.168.204.37@tcp:41:rm.0 Request processed in 134us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448471.209774:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1788448471.212908:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448471.213011:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902774912 00000100:00100000:1.0:1788448471.213022:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902774912 00000100:00100000:1.0:1788448471.213079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:1.0:1788448471.213097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902774912:12345-192.168.204.37@tcp:101:rm.0 00010000:00010000:1.0:1788448471.213118:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448471.213139:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab047 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109da expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213241:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213256:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213267:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213281:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213287:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213311:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213419:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213427:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213433:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448471.213461:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788448471.213465:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448471.213487:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213501:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213509:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213514:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213520:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213525:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448471.213529:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213542:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213555:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448471.213558:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448471.213562:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213568:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab04e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213582:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213587:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213593:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213598:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448471.213602:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213608:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213615:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448471.213618:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448471.213620:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213635:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab055 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213668:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab047 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109da expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213680:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109da expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.213687:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbf900) 00010000:00010000:1.0:1788448471.213690:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448471.213692:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9cc00, rc 0) 00000100:00100000:1.0:1788448471.213764:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+17:9680:x1875323902774912:12345-192.168.204.37@tcp:101:rm.0 Request processed in 669us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448471.213772:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:1.0:1788448471.218816:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.218951:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902775168 00000100:00100000:3.0:1788448471.218963:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902775168 00000100:00100000:3.0:1788448471.219041:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:3.0:1788448471.219052:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+17:9680:x1875323902775168:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:3.0:1788448471.219119:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788448471.219150:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab05c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109da expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219173:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab008 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109be expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219234:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a808bbf900) 00010000:00010000:3.0:1788448471.219270:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab01d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109c5 expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219282:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448471.219285:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448471.219303:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219316:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219325:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219339:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219346:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219352:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219492:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219501:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.219507:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448471.220280:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:3.0:1788448471.220299:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331827112343ns, next at 332827110070ns, rc = 0 00010000:00010000:3.0:1788448471.220364:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220375:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220384:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220391:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220397:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220402:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220423:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448471.220443:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220450:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220455:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220461:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448471.220465:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220484:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220497:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a829674b00) 00010000:00010000:3.0:1788448471.220499:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788448471.220504:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220510:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247a00/0xd0e9b344b90ab071 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220528:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220534:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220540:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220545:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448471.220548:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220553:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220559:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448471.220561:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448471.220564:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448471.220581:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247e00/0xd0e9b344b90ab063 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448471.220591:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000167e7228 reply state 00000000b7f82162 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448471.220600:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448471.220703:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902775168:12345-192.168.204.37@tcp:36:rm.0 Request processed in 1649us (1892us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788448471.220714:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00010000:00010000:0.0:1788448471.220944:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448471.220952:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.220958:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448471.220962:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.220990:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.220999:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff99a829674b00) 00010000:00010000:0.0:1788448471.221002:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448471.221004:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.221009:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab078 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.221023:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448471.221025:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448471.221026:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448471.227884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.228095:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902775424 00000100:00100000:3.0:1788448471.228107:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902775424 00000100:00100000:3.0:1788448471.228169:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:3.0:1788448471.228180:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:9680:x1875323902775424:12345-192.168.204.37@tcp:35:rm.0 00000100:00100000:3.0:1788448471.228477:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+17:9680:x1875323902775424:12345-192.168.204.37@tcp:35:rm.0 Request processed in 297us (1295us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788448471.228487:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:3.0:1788448471.231923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448471.232075:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902775680 00000100:00100000:0.0:1788448471.232094:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902775680 00000100:00100000:0.0:1788448471.232157:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1788448471.232167:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+17:9680:x1875323902775680:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:0.0:1788448471.232250:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788448471.232279:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab039 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109d3 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232300:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90aafd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109b0 expref: 16 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232310:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448471.232325:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aaf98 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109a2 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232356:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448471.232363:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448471.232387:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232399:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232409:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232423:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232504:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232512:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232761:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232770:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.232777:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235539:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235557:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235574:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235581:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448471.235585:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235611:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235629:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xb7cbccd0 (ffff99a829674000) 00010000:00010000:1.0:1788448471.235632:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448471.235636:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448471.235642:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab06a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xb7cbccd0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448471.236789:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1788448471.236814:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236894:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236901:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236906:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448471.236910:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236917:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236929:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448471.236931:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788448471.236934:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236940:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ab08d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236963:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.236979:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.237056:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.237060:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448471.237070:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.237076:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.237153:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a80bd82000) 00010000:00010000:0.0:1788448471.237156:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448471.237159:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.237165:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab07f lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448471.237180:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fce4b14b reply state 00000000bfa8e5b8 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448471.237305:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448471.237399:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+15:9680:x1875323902775680:12345-192.168.204.37@tcp:36:rm.0 Request processed in 5230us (5484us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788448471.237408:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00010000:00010000:0.0:1788448471.242809:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242838:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242846:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242852:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448471.242857:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242883:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242901:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff99a80bd82600) 00010000:00010000:0.0:1788448471.242904:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448471.242908:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448471.242915:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab086 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448471.481975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448471.482065:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448471.483006:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902775808 00000100:00100000:0.0:1788448471.483021:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902775808 00000100:00100000:0.0:1788448471.483143:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 247 00000100:00100000:0.0:1788448471.483155:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902775808:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448471.483295:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902775808:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 142us (1230us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448471.483303:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 247 00000100:00100000:1.0:1788448471.484002:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902775936 00000100:00100000:1.0:1788448471.484008:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902775936 00000100:00100000:1.0:1788448471.484052:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:1.0:1788448471.484060:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902775936:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448471.484112:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902775936:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 53us (2161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448471.484120:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1788448471.493720:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448471.493833:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776064 00000100:00100000:0.0:1788448471.493843:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776064 00000100:00100000:0.0:1788448471.493985:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:0.0:1788448471.493996:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902776064:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448471.494086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902776064:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 93us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448471.494094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00080000:2.0:1788448471.496209:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448471.584507:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448472.608651:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448472.673763:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926925056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448472.673853:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:3.0:1788448472.674760:0:6880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 333281571916ns, next at 334281569226ns, rc = 0 00000100:00100000:2.0:1788448472.686017:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925056 00000100:00100000:2.0:1788448472.686044:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925056 00000100:00100000:2.0:1788448472.686123:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788448472.686133:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926925056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448472.686177:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448472.686283:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926925056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (12430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448472.686291:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:2.0:1788448472.686356:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359b2d80 x1875323926925056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448488 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448472.686376:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926925056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448472.687139:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448473.633858:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448474.656491:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448474.720632:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926925312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.720762:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448474.720836:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926925824:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.720865:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448474.720924:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448474.720930:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926925440:0@lo:400:kworker.0 00000100:00100000:3.0:1788448474.720954:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.721118:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926925184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721152:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.721178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926925696:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.721243:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448474.721248:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926925568:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448474.721298:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925824 00000100:00100000:0.0:1788448474.721306:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925824 00000100:00100000:0.0:1788448474.721359:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925568 00000100:00100000:0.0:1788448474.721362:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925568 00000100:00100000:0.0:1788448474.721381:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448474.721390:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926925824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721447:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926925824:12345-0@lo:400:kworker.0 Request processed in 57us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721454:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788448474.721470:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448474.721477:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926925568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721507:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926925568:12345-0@lo:400:kworker.0 Request processed in 31us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721513:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448474.721531:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925312 00000100:00100000:0.0:1788448474.721534:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925312 00000100:00100000:0.0:1788448474.721558:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925440 00000100:00100000:0.0:1788448474.721569:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925440 00000100:00100000:0.0:1788448474.721588:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925696 00000100:00100000:0.0:1788448474.721591:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925696 00000100:00100000:0.0:1788448474.721604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448474.721609:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926925312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721652:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926925312:12345-0@lo:400:kworker.0 Request processed in 43us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721658:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788448474.721669:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448474.721675:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926925440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721701:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926925440:12345-0@lo:400:kworker.0 Request processed in 26us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721707:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448474.721718:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448474.721724:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926925696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721751:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926925696:12345-0@lo:400:kworker.0 Request processed in 27us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721757:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788448474.721776:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925184 00000100:00100000:0.0:1788448474.721780:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925184 00000100:00100000:0.0:1788448474.721804:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1788448474.721812:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926925184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721840:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926925184:12345-0@lo:400:kworker.0 Request processed in 30us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448474.721847:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00080000:0.0:1788448474.721880:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448474.721885:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448474.721894:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788448474.721946:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d5880 x1875323926925568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448474.721962:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926925568:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721973:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926925184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.721984:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926925696:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.722017:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926925440:0@lo:400:kworker.0 00000100:00100000:0.0:1788448474.722027:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926925312:0@lo:400:kworker.0 00010000:00080000:0.0:1788448474.722037:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4a80 x1875323926925824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448490 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448474.722046:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926925824:0@lo:400:kworker.0 00000100:00100000:0.0:1788448475.232975:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448475.233001:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926925952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448475.233076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448475.233219:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926925952 00000100:00100000:1.0:1788448475.233228:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926925952 00000100:00100000:1.0:1788448475.233282:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788448475.233290:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926925952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448475.233322:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448475.233369:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926925952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448475.233376:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1788448475.233427:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d7b80 x1875323926925952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448491 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448475.233445:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926925952:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788448475.681864:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448475.849434:0:11609:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:2.0:1788448476.316523:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:2.0:1788448476.316573:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1788448476.316595:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:2.0:1788448476.316842:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926926080:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788448476.317549:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448476.317642:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926080 00000100:00100000:0.0:1788448476.317968:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926080 00000100:00080000:2.0:1788448476.318028:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448476.318385:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788448476.318408:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926926080:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788448476.318444:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1788448476.318479:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a998ed5, atime: 0x6a998ed5, ctime: 0x6a998ed5, blocks: 0x1 00010000:00010000:0.0:1788448476.318486:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.318502:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=336s v=(0 0) 00010000:00010000:0.0:1788448476.318517:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448476.318523:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.318542:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.318552:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.318559:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448476.318574:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448476.318719:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448476.318726:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.318744:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448476.318748:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.318757:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.318775:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448476.318783:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d5c933d/0xd0e9b344b90ab094 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448476.319203:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926926080:12345-0@lo:6:osp-syn-0-0.0 Request processed in 787us (1633us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1788448476.319212:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1788448476.319513:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a834877800/2, rc 0, transno 4294967300 00000100:00100000:2.0:1788448476.319521:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926926080:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788448476.320029:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448476.320031:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448476.320033:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448476.601220:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448476.601259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448476.601286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448476.601345:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448476.601380:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776320 00000100:00100000:2.0:1788448476.601491:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776320 00000100:00100000:2.0:1788448476.601633:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776576 00000100:00100000:2.0:1788448476.601638:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776576 00000100:00100000:2.0:1788448476.601896:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:2.0:1788448476.601909:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902776320:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448476.602010:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902776320:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 104us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.602018:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:2.0:1788448476.602037:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1788448476.602044:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902776576:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448476.602069:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902776576:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.602075:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1788448476.602101:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776192 00000100:00100000:2.0:1788448476.602116:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776192 00000100:00100000:2.0:1788448476.602148:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 249 00000100:00100000:2.0:1788448476.602155:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902776192:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448476.602180:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902776192:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.602222:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 249 00000100:00100000:2.0:1788448476.602253:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776448 00000100:00100000:2.0:1788448476.602258:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776448 00000100:00100000:2.0:1788448476.602289:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:2.0:1788448476.602296:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902776448:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448476.603802:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902776448:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (978us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448476.603818:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00080000:2.0:1788448476.603877:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448476.603884:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448476.705132:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788448477.244126:0:11661:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc41ae12c0 20000000:00000080:3.0:1788448477.244150:0:11661:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a70458d000 uarg=0000000000000000 20000000:01000000:3.0:1788448477.244368:0:11661:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788448477.244386:0:11661:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788448477.244391:0:11661:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1788448477.248812:0:11662:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788448477.258273:0:11661:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1788448477.279540:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1788448477.279598:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1788448477.279655:0:11661:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1788448477.279673:0:11661:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448477.279694:0:11661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279713:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279720:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279740:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279749:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279756:0:11661:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279762:0:11661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279801:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279816:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.279833:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926208:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448477.279962:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 12 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.279971:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 12 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.279979:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926336:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448477.280009:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.280028:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 18 pid: 5829 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.280037:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926464:0@lo:104: 00000100:00100000:0.0:1788448477.280076:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448477.280117:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 18 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.280125:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 18 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.280133:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926592:0@lo:104: 00000100:00100000:0.0:1788448477.280156:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448477.280218:0:11661:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448477.280226:0:11661:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 18 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.280233:0:11661:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926720:0@lo:104: 00000100:00100000:0.0:1788448477.280258:0:11661:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448477.280267:0:11661:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807887540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448477.280630:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788448477.280646:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926464 00000100:00100000:3.0:1788448477.280653:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926464 00000100:00100000:3.0:1788448477.280688:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926592 00000100:00100000:3.0:1788448477.280691:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926592 00000100:00100000:3.0:1788448477.280701:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926720 00000100:00100000:3.0:1788448477.280703:0:5821:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926720 00000100:00100000:3.0:1788448477.280716:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448477.280724:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:11661:x1875323926926464:12345-0@lo:104: 00010000:00010000:3.0:1788448477.280737:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.280797:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448477.280871:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+5:11661:x1875323926926464:12345-0@lo:104: Request processed in 148us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.280878:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448477.280897:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448477.280903:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:11661:x1875323926926592:12345-0@lo:104: 00010000:00010000:3.0:1788448477.280911:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.280944:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788448477.280949:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+4:11661:x1875323926926592:12345-0@lo:104: Request processed in 47us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.280954:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448477.280968:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448477.280983:0:5821:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808a05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:11661:x1875323926926720:12345-0@lo:104: 00010000:00010000:3.0:1788448477.280991:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281023:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788448477.281028:0:5821:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808a05450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:623f2df2-d49f-4f54-8e7f-befebe2e7643+3:11661:x1875323926926720:12345-0@lo:104: Request processed in 47us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.281034:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1788448477.281231:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448477.281237:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281245:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448477.281249:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281259:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448477.281266:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448477.281273:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448477.281303:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281310:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448477.281329:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281346:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842179e00/0xd0e9b344b90aaf52 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf59 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281411:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448477.281415:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281421:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246000 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448477.281424:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281429:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448477.281435:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448477.281439:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448477.281452:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281457:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448477.281469:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281475:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809246000/0xd0e9b344b90aaf44 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf4b expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281483:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448477.281491:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281497:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178400 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448477.281500:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281506:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448477.281512:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448477.281516:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448477.281532:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281536:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448477.281541:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281546:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842178400/0xd0e9b344b90aaf36 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90aaf3d expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.281557:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448477.281559:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448477.281561:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448477.281568:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448477.281629:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448477.281645:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448477.281658:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926926848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448477.281693:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448477.281740:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926927104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448477.281763:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448477.281781:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448477.281786:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926926976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448477.281807:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448477.281831:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926848 00000100:00100000:2.0:1788448477.281843:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926848 00010000:00010000:2.0:1788448477.281876:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 19 pid: 5829 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448477.281898:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927104 00000100:00100000:2.0:1788448477.281900:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927104 00010000:00010000:2.0:1788448477.281911:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 20 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448477.281921:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926926976 00000100:00100000:2.0:1788448477.281924:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926926976 00010000:00010000:2.0:1788448477.281934:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 21 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448477.281946:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448477.281953:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+21:3311:x1875323926926848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448477.281965:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448477.281970:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 21 pid: 5829 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.281978:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 21 pid: 5829 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.281994:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448477.282025:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+21:3311:x1875323926926848:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448477.282030:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448477.282044:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448477.282050:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3310:x1875323926927104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448477.282056:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448477.282066:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 20 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.282073:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 20 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.282082:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448477.282106:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3310:x1875323926927104:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448477.282112:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448477.282123:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448477.282130:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804617c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926926976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448477.282136:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448477.282140:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 19 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.282147:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 19 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.282155:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448477.282174:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804617c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926926976:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448477.282180:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448477.282268:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926926976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448477.282276:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926927104:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448477.282300:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926926848:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448477.286804:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926208:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448477.286828:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247200/0xd0e9b344b90aaf59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaf52 expref: 18 pid: 5829 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.286857:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926464:0@lo:104: 00010000:00010000:0.0:1788448477.286870:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed800/0xd0e9b344b90aaf4b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaf44 expref: 17 pid: 5830 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.286900:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926592:0@lo:104: 00010000:00010000:0.0:1788448477.286914:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90aaf3d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90aaf36 expref: 16 pid: 5831 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448477.286922:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926720:0@lo:104: 00000100:00100000:2.0:1788448477.290507:0:11661:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11661:1875323926926336:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448477.290575:0:11661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448477.293212:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448477.293252:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448477.293386:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776832 00000100:00100000:3.0:1788448477.293396:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776832 00010000:00010000:3.0:1788448477.293438:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 13 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.293494:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776704 00000100:00100000:3.0:1788448477.293497:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776704 00010000:00010000:3.0:1788448477.293515:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 14 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448477.293543:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:3.0:1788448477.293553:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+14:2353:x1875323902776832:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448477.293579:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448477.293586:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 14 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293598:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 14 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293617:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83cc9c800/0xd0e9b344b90aaf60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051098d expref: 14 pid: 5830 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293633:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448477.293683:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902776832:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 131us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.293690:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:3.0:1788448477.293711:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:3.0:1788448477.293717:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+12:2353:x1875323902776704:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448477.293810:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448477.293817:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293838:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293886:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ec000/0xd0e9b344b90aaf67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510994 expref: 12 pid: 5831 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293900:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293908:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293924:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293931:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293937:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293944:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293949:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448477.293953:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293960:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293984:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.293994:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448477.294014:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+11:2353:x1875323902776704:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 297us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.294021:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00010000:00010000:2.0:1788448477.294508:0:11661:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.294517:0:11661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448477.294524:0:11661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed200/0xd0e9b344b90ab09b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448477.728354:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448477.795588:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926927232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448477.795667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448477.795810:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927232 00000100:00100000:3.0:1788448477.795818:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927232 00000100:00100000:3.0:1788448477.795885:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448477.795895:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926927232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448477.795930:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448477.795973:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926927232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448477.795979:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788448477.796226:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926927232:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448478.581122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448478.581268:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902776960 00000100:00100000:2.0:1788448478.581278:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902776960 00000100:00100000:2.0:1788448478.581331:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 250 00000100:00100000:2.0:1788448478.581341:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+11:5593:x1875323902776960:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448478.581357:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448478.581376:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178000/0xd0e9b344b90ab0a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109e1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.581404:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178000/0xd0e9b344b90ab0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e1 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.581415:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178000/0xd0e9b344b90ab0a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e1 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448478.581437:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178000, rc 0) 00000100:00100000:2.0:1788448478.581497:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902776960:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 157us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448478.581504:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 250 00000100:00100000:3.0:1788448478.590227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448478.590407:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777088 00000100:00100000:0.0:1788448478.590422:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777088 00000100:00100000:0.0:1788448478.590486:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 251 00000100:00100000:0.0:1788448478.590496:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902777088:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448478.590805:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902777088:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 309us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448478.590814:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 251 00000100:00100000:0.0:1788448478.598119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448478.598270:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777216 00000100:00100000:3.0:1788448478.598281:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777216 00000100:00100000:3.0:1788448478.598342:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 252 00000100:00100000:3.0:1788448478.598351:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902777216:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448478.598580:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902777216:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 229us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.598588:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 252 00000100:00100000:2.0:1788448478.612649:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448478.616538:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777344 00000100:00100000:0.0:1788448478.616554:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777344 00000100:00100000:1.0:1788448478.618373:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 253 00000100:00100000:1.0:1788448478.618388:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:9951:x1875323902777344:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448478.618715:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:9951:x1875323902777344:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 328us (6075us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.618723:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 253 00000100:00100000:0.0:1788448478.630305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448478.630460:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777472 00000100:00100000:2.0:1788448478.630472:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777472 00000100:00100000:2.0:1788448478.630524:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 254 00000100:00100000:2.0:1788448478.630535:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:9951:x1875323902777472:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448478.631047:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+12:9951:x1875323902777472:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 511us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448478.631055:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 254 00000100:00100000:0.0:1788448478.638549:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448478.638767:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777600 00000100:00100000:1.0:1788448478.638777:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777600 00000100:00100000:1.0:1788448478.638851:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 255 00000100:00100000:1.0:1788448478.638863:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+12:5593:x1875323902777600:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448478.638882:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448478.638901:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9d400/0xd0e9b344b90ab0a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109e8 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.638931:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9d400/0xd0e9b344b90ab0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e8 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.638954:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9d400/0xd0e9b344b90ab0a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e8 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448478.638964:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d400, rc 0) 00000100:00100000:1.0:1788448478.639031:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80338b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902777600:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 170us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.639058:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 255 00000100:00100000:0.0:1788448478.641553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448478.641750:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777728 00000100:00100000:3.0:1788448478.641763:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777728 00000100:00100000:3.0:1788448478.641847:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 256 00000100:00100000:3.0:1788448478.641858:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902777728:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448478.643084:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902777728:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 1220us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448478.643094:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 256 00000100:00100000:1.0:1788448478.652110:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448478.663624:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777856 00000100:00100000:2.0:1788448478.663645:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777856 00000100:00100000:2.0:1788448478.663798:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 257 00000100:00100000:2.0:1788448478.663810:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902777856:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448478.664092:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:5593:x1875323902777856:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 284us (11990us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448478.664101:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 257 00000100:00100000:0.0:1788448478.689796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448478.690295:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902777984 00000100:00100000:3.0:1788448478.690306:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902777984 00000100:00100000:1.0:1788448478.690911:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 258 00000100:00100000:1.0:1788448478.690926:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:9955:x1875323902777984:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448478.691253:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:9955:x1875323902777984:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 330us (1470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448478.691261:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 258 00000100:00100000:0.0:1788448478.701799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448478.702383:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778112 00000100:00100000:2.0:1788448478.702400:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778112 00000100:00100000:2.0:1788448478.703324:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 259 00000100:00100000:2.0:1788448478.703341:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:9955:x1875323902778112:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448478.704146:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:9955:x1875323902778112:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 801us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448478.704170:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 259 00010000:00010000:3.0:1788448478.752638:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448479.200371:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448479.200382:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80888c000 from 7 10000000:01000000:2.0:1788448479.200389:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448479.200455:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.200469:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.200483:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.200534:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448479.200638:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.200737:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a6716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.200867:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927360 00000100:00100000:3.0:1788448479.200879:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927360 00000100:00100000:3.0:1788448479.200957:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788448479.200969:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:5834:x1875323926927360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448479.200987:0:5830:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448479.201005:0:5830:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a809246000/0xd0e9b344b90ab0b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ab0b0 expref: -99 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.201038:0:5830:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a809246000/0xd0e9b344b90ab0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0b0 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.201049:0:5830:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a809246000/0xd0e9b344b90ab0b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0b0 expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.201060:0:5830:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246000, rc 0) 00000100:00100000:3.0:1788448479.201117:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926927360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 150us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.201137:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1788448479.201332:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448479.201351:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.201386:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.201471:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.201507:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.201542:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.202106:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927488 00000100:00100000:1.0:1788448479.202116:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927488 00000100:00100000:1.0:1788448479.202170:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788448479.202180:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926927488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788448479.202583:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926927488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 403us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.202593:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1788448479.204354:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.204451:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.204564:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.204634:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079146c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.205381:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927616 00000100:00100000:1.0:1788448479.205393:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927616 00000100:00100000:1.0:1788448479.205479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1788448479.205492:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926927616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448479.205839:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926927616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 348us (1274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.205848:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788448479.206182:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926927616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.206929:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11675:1875323926927744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448479.207006:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.207120:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.216804:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927744 00000100:00100000:3.0:1788448479.216842:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927744 00000100:00100000:3.0:1788448479.216988:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788448479.217003:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:11675:x1875323926927744:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448479.217436:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:11675:x1875323926927744:12345-0@lo:502:llog_process_th.0 Request processed in 434us (10428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.217447:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788448479.217875:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11675:1875323926927744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448479.217932:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448479.217945:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448479.217949:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448479.217958:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a80888c000 00000020:00000080:0.0:1788448479.217962:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448479.218103:0:11675:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11675:1875323926927872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448479.218282:0:11675:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.218335:0:11675:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807887540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.223028:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926927872 00000100:00100000:1.0:1788448479.223053:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926927872 00000100:00100000:1.0:1788448479.223235:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1788448479.223252:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:11675:x1875323926927872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448479.223685:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:11675:x1875323926927872:12345-0@lo:502:llog_process_th.0 Request processed in 436us (5402us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.223695:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788448479.225266:0:11675:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11675:1875323926927872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448479.225357:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448479.225369:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448479.225372:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788448479.225380:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788448479.225740:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788448479.225770:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448479.225786:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.225799:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448479.225822:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448479.225825:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a8092e0800 from 7 10000000:01000000:3.0:1788448479.225830:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448479.225885:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.225895:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.225906:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448479.225938:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.226020:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.226063:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250900 going to sleep for 11 seconds 00000100:00100000:1.0:1788448479.226162:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928000 00000100:00100000:1.0:1788448479.226171:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928000 00000100:00100000:1.0:1788448479.226268:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788448479.226279:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:5834:x1875323926928000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448479.226297:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448479.226318:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90ab0c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ab0be expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.226351:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90ab0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0be expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.226365:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90ab0c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0be expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448479.226377:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c200, rc 0) 00000100:00100000:1.0:1788448479.226435:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804693c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.226442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788448479.226774:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448479.226794:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.226804:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448479.226909:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.226946:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.226983:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079146c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.227044:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928128 00000100:00100000:3.0:1788448479.227068:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928128 00000100:00100000:3.0:1788448479.227110:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788448479.227119:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.227499:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.227509:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1788448479.227897:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.227948:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.228006:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.228045:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079146c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.228068:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928256 00000100:00100000:0.0:1788448479.228072:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928256 00000100:00100000:0.0:1788448479.228104:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788448479.228112:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.228448:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804692850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 334us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.228457:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788448479.228509:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.228762:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11676:1875323926928384:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448479.228803:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.228838:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928384 00000100:00100000:0.0:1788448479.228843:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928384 00000100:00100000:0.0:1788448479.228865:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1788448479.228871:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:11676:x1875323926928384:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448479.229262:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.229560:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:11676:x1875323926928384:12345-0@lo:502:llog_process_th.0 Request processed in 686us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.229569:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788448479.230395:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11676:1875323926928384:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448479.230461:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448479.230480:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448479.230484:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788448479.230494:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a8092e0800 00000020:00000080:1.0:1788448479.230497:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788448479.230625:0:11676:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11676:1875323926928512:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448479.230700:0:11676:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.230821:0:11676:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.231686:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928512 00000100:00100000:3.0:1788448479.231703:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928512 00000100:00100000:3.0:1788448479.231925:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:3.0:1788448479.231942:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:11676:x1875323926928512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448479.232373:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804690050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:11676:x1875323926928512:12345-0@lo:502:llog_process_th.0 Request processed in 435us (1671us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.232691:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788448479.233169:0:11676:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11676:1875323926928512:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448479.233272:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448479.233287:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448479.233289:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788448479.233293:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788448479.234151:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788448479.234223:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448479.234235:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.234248:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448479.234260:0:5834:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448479.234263:0:5834:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a80badd000 from 7 10000000:01000000:3.0:1788448479.234267:0:5834:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448479.234319:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.234329:0:5834:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.234358:0:5834:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448479.234388:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.234474:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.234525:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448479.238384:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928640 00000100:00100000:0.0:1788448479.238407:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928640 00000100:00100000:0.0:1788448479.238481:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788448479.238493:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:5834:x1875323926928640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448479.238517:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448479.238542:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90ab0d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ab0cc expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.238580:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90ab0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0cc expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.238593:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90ab0d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ab0cc expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448479.238606:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed600, rc 0) 00000100:00100000:0.0:1788448479.238753:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804691450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926928640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 261us (4278us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.238762:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1788448479.238939:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448479.238968:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448479.238980:0:5834:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448479.239110:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448479.239174:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.239258:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a6716c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.239414:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928768 00000100:00100000:3.0:1788448479.239420:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928768 00000100:00100000:3.0:1788448479.239466:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788448479.239477:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926928768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.239845:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926928768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 370us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.239854:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:3.0:1788448479.239906:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.239947:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448479.239992:0:5834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448479.240007:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.240020:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926928896 00000100:00100000:3.0:1788448479.240024:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926928896 00000100:00100000:3.0:1788448479.240044:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788448479.240050:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926928896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448479.241795:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:5834:x1875323926928896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1727us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.241823:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1788448479.242255:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:623f2df2-d49f-4f54-8e7f-befebe2e7643:5834:1875323926928896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448479.243058:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11678:1875323926929024:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448479.243159:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.243243:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409300 going to sleep for 11 seconds 00000100:00100000:2.0:1788448479.243456:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929024 00000100:00100000:2.0:1788448479.243466:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929024 00000100:00100000:2.0:1788448479.243531:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1788448479.243543:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:11678:x1875323926929024:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448479.243858:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:11678:x1875323926929024:12345-0@lo:502:llog_process_th.0 Request processed in 315us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.243867:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788448479.244611:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11678:1875323926929024:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448479.244666:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448479.244682:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448479.244686:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448479.244710:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a80badd000 00000020:00000080:0.0:1788448479.244714:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448479.244985:0:11678:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11678:1875323926929152:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448479.245080:0:11678:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448479.245143:0:11678:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448479.248522:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929152 00000100:00100000:3.0:1788448479.248546:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929152 00000100:00100000:3.0:1788448479.248662:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788448479.248676:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:11678:x1875323926929152:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448479.249087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:11678:x1875323926929152:12345-0@lo:502:llog_process_th.0 Request processed in 413us (4006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448479.249096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788448479.249601:0:11678:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:623f2df2-d49f-4f54-8e7f-befebe2e7643:11678:1875323926929152:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448479.249650:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448479.249662:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448479.249665:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788448479.249671:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788448479.254422:0:5834:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1788448479.254481:0:5834:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448479.254499:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448479.254516:0:5834:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448479.268032:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788448479.777241:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448479.840605:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926929536:0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.840701:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.840789:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448479.840796:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926929408:0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.840834:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.840853:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926929920:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.841042:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926929280:0@lo:400:kworker.0 00000100:00100000:0.0:1788448479.841149:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929536 00000100:00100000:0.0:1788448479.841161:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929536 00000100:00100000:0.0:1788448479.841261:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929408 00000100:00100000:0.0:1788448479.841265:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929408 00000100:00100000:0.0:1788448479.841290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788448479.841301:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926929536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.841527:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926929664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.842699:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.843119:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926929792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.843163:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448479.843326:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929792 00000100:00100000:1.0:1788448479.843335:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929792 00000100:00100000:1.0:1788448479.843394:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448479.843404:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926929408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.843466:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926929408:12345-0@lo:400:kworker.0 Request processed in 63us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.843474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448479.843496:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788448479.843504:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926929792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.843539:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926929792:12345-0@lo:400:kworker.0 Request processed in 36us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.843545:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788448479.843566:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448479.843604:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926929792:0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.843651:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929280 00000100:00100000:1.0:1788448479.843655:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929280 00000100:00100000:1.0:1788448479.843690:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1788448479.843697:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926929280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.843734:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926929280:12345-0@lo:400:kworker.0 Request processed in 38us (1041us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.843760:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788448479.844015:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926929536:12345-0@lo:400:kworker.0 Request processed in 2715us (3312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448479.844024:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788448479.844067:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926929280:0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.844438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.844493:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926929536:0@lo:400:kworker.0 00000100:00100000:3.0:1788448479.844510:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448479.844514:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926929408:0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.844545:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929920 00000100:00100000:2.0:1788448479.844559:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929920 00000100:00100000:1.0:1788448479.844654:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926929664 00000100:00100000:1.0:1788448479.844659:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926929664 00000100:00100000:2.0:1788448479.844726:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788448479.844734:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926929920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448479.844817:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926929920:12345-0@lo:400:kworker.0 Request processed in 84us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448479.844824:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:2.0:1788448479.844856:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8295af480 x1875323926929920/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448495 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448479.844878:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926929920:0@lo:400:kworker.0 00000100:00080000:3.0:1788448479.845515:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448479.845523:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448479.846609:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448479.846630:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926929664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448479.846743:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926929664:12345-0@lo:400:kworker.0 Request processed in 123us (2232us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448479.846751:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448479.846943:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926929664:0@lo:400:kworker.0 00000040:00080000:3.0:1788448480.289568:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788448480.352643:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448480.352676:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926930048:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448480.352769:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448480.353133:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930048 00000100:00100000:1.0:1788448480.353145:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930048 00000100:00100000:1.0:1788448480.353230:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788448480.353243:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926930048:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448480.353292:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448480.353358:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926930048:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448480.353366:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1788448480.353603:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d5c00 x1875323926930048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448496 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448480.353626:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926930048:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448480.802746:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448481.472427:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000100:00100000:2.0:1788448481.721988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448481.722106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448481.725997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448481.726048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448481.726824:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778240 00000100:00100000:0.0:1788448481.726837:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778240 00000100:00100000:0.0:1788448481.726911:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 276 00000100:00100000:0.0:1788448481.726922:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902778240:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448481.726998:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902778240:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 77us (1014us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448481.727006:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 276 00000100:00100000:0.0:1788448481.727043:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778496 00000100:00100000:0.0:1788448481.727047:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778496 00000100:00100000:0.0:1788448481.727087:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:0.0:1788448481.727094:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778496:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448481.727121:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778496:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 28us (1074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448481.727127:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00080000:0.0:1788448481.727280:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448481.730407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778368 00000100:00100000:1.0:1788448481.730424:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778368 00000100:00100000:1.0:1788448481.730512:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778624 00000100:00100000:1.0:1788448481.730517:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778624 00000100:00100000:1.0:1788448481.730555:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:1.0:1788448481.730565:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778368:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448481.730645:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778368:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 81us (8666us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448481.730653:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:1.0:1788448481.730670:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:1.0:1788448481.730692:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902778624:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448481.731003:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902778624:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 311us (8896us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448481.731011:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00080000:0.0:1788448481.731602:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448481.824462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448482.848318:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448482.913749:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926930176:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448482.913826:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448482.913910:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930176 00000100:00100000:2.0:1788448482.913918:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930176 00000100:00100000:2.0:1788448482.913982:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448482.913992:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926930176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448482.914024:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448482.914066:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926930176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448482.914074:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448482.914107:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1788448482.914112:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a834877800, transno 4294967300 00000100:00100000:2.0:1788448482.914133:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926930176:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448482.918077:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448483.873333:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448484.897754:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448484.960513:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926930432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448484.960588:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448484.960853:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926930304:0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.960896:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448484.960958:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930304 00000100:00100000:1.0:1788448484.960965:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930304 00000100:00100000:1.0:1788448484.961027:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788448484.961037:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926930304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.961088:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926930304:12345-0@lo:400:kworker.0 Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448484.961096:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:1.0:1788448484.961143:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926930304:0@lo:400:kworker.0 00000100:00100000:2.0:1788448484.961949:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926930560:0@lo:400:kworker.0 00000100:00100000:2.0:1788448484.961989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448484.962063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930432 00000100:00100000:2.0:1788448484.962068:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930432 00000100:00100000:2.0:1788448484.962100:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930560 00000100:00100000:2.0:1788448484.962103:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930560 00000100:00100000:2.0:1788448484.962137:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1788448484.962144:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926930432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.962293:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448484.962303:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926930560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.962349:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926930560:12345-0@lo:400:kworker.0 Request processed in 48us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448484.962357:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788448484.962394:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926930560:0@lo:400:kworker.0 00000100:00080000:1.0:1788448484.962425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448484.965270:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448484.965299:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926930944:0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965374:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448484.965466:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926930816:0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965496:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448484.965519:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448484.965526:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926930688:0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965549:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448484.965580:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930816 00000100:00100000:1.0:1788448484.965588:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930816 00000100:00100000:1.0:1788448484.965642:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788448484.965652:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926930816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965716:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926930816:12345-0@lo:400:kworker.0 Request processed in 64us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448484.965724:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1788448484.965746:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448484.965757:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930944 00000100:00100000:1.0:1788448484.965761:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930944 00000100:00100000:1.0:1788448484.965791:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926930688 00000100:00100000:1.0:1788448484.965794:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926930688 00000100:00100000:1.0:1788448484.965812:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448484.965819:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926930944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965870:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926930944:12345-0@lo:400:kworker.0 Request processed in 51us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448484.965877:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788448484.965888:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448484.965894:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926930688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965921:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926930688:12345-0@lo:400:kworker.0 Request processed in 28us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448484.965927:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:1.0:1788448484.965953:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448484.965957:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448484.965983:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926930688:0@lo:400:kworker.0 00000100:00100000:1.0:1788448484.965994:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926930816:0@lo:400:kworker.0 00010000:00080000:1.0:1788448484.966264:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce35c00 x1875323926930944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448500 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448484.966276:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce35c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926930944:0@lo:400:kworker.0 00000100:00100000:2.0:1788448484.973031:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926930432:12345-0@lo:400:kworker.0 Request processed in 10867us (12423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448484.973047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788448484.979621:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926930432:0@lo:400:kworker.0 00000100:00100000:3.0:1788448485.472599:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448485.472625:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926931072:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448485.472707:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448485.472851:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931072 00000100:00100000:0.0:1788448485.472861:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931072 00000100:00100000:0.0:1788448485.472921:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788448485.472944:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926931072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448485.472978:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448485.473033:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926931072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448485.473041:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1788448485.473288:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d4a80 x1875323926931072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448501 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448485.473310:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926931072:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448485.920342:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448486.835033:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448486.835134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448486.835166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448486.835239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448486.835287:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778880 00000100:00100000:2.0:1788448486.835296:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778880 00000100:00100000:2.0:1788448486.835357:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779136 00000100:00100000:2.0:1788448486.835360:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779136 00000100:00100000:2.0:1788448486.835382:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:2.0:1788448486.835391:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778880:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448486.835466:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902778880:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448486.835474:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:2.0:1788448486.835491:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:2.0:1788448486.835513:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902779136:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448486.835539:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902779136:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448486.835546:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00080000:2.0:1788448486.835574:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448486.835652:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779008 00000100:00100000:0.0:1788448486.835656:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779008 00000100:00100000:0.0:1788448486.835713:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:0.0:1788448486.835721:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902779008:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448486.835750:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902779008:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448486.835757:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00080000:2.0:1788448486.836296:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448486.837917:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902778752 00000100:00100000:1.0:1788448486.837932:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902778752 00000100:00100000:1.0:1788448486.838014:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 278 00000100:00100000:1.0:1788448486.838026:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902778752:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448486.838111:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902778752:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 87us (3091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448486.838119:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 278 00010000:00010000:3.0:1788448486.946821:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448487.968435:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448488.032938:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448488.032971:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926931200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448488.033049:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448488.033599:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931200 00000100:00100000:3.0:1788448488.033609:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931200 00000100:00080000:2.0:1788448488.033675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448488.033691:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448488.033711:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926931200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448488.033746:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448488.033809:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926931200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448488.033817:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788448488.033866:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926931200:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448488.993879:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448490.016682:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448490.082307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926931584:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.082310:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926931456:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.082386:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926931328:0@lo:400:kworker.0 00000100:00100000:1.0:1788448490.082463:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926931712:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.086234:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.086317:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8087b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926931968:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.086356:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.086433:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931456 00000100:00100000:3.0:1788448490.086441:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931456 00000100:00100000:3.0:1788448490.086490:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788448490.086500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926931456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.086561:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926931456:12345-0@lo:400:kworker.0 Request processed in 57us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.086766:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788448490.086820:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931968 00000100:00100000:3.0:1788448490.086825:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931968 00000100:00100000:3.0:1788448490.086862:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788448490.086868:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926931968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.086906:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926931968:12345-0@lo:400:kworker.0 Request processed in 38us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.086923:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1788448490.086947:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448490.086979:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926931456:0@lo:400:kworker.0 00010000:00080000:3.0:1788448490.086993:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8087b2680 x1875323926931968/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448506 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448490.087004:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8087b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926931968:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.091341:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448490.091423:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926931840:0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.091462:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448490.091530:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931840 00000100:00100000:0.0:1788448490.091539:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931840 00000100:00100000:0.0:1788448490.091593:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448490.091613:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926931840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448490.091670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926931840:12345-0@lo:400:kworker.0 Request processed in 69us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448490.091678:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788448490.091731:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834874000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926931840:0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.093238:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931328 00000100:00100000:3.0:1788448490.093249:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931328 00000100:00100000:3.0:1788448490.093297:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788448490.093306:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926931328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.093379:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926931328:12345-0@lo:400:kworker.0 Request processed in 74us (2047us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.093386:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00080000:3.0:1788448490.093429:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448490.093458:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926931328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448490.093804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448490.096752:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448490.099101:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931584 00000100:00100000:3.0:1788448490.099711:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931584 00000100:00100000:3.0:1788448490.099791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788448490.099800:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926931584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448490.099896:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926931584:12345-0@lo:400:kworker.0 Request processed in 97us (6093us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448490.099920:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1788448490.099981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926931584:0@lo:400:kworker.0 00000100:00080000:0.0:1788448490.100094:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448490.100333:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926931712 00000100:00100000:2.0:1788448490.100339:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926931712 00000100:00100000:2.0:1788448490.100392:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788448490.100400:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926931712:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788448490.100400:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448490.100445:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926931712:12345-0@lo:400:kworker.0 Request processed in 47us (3700us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.100452:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448490.100540:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926931712:0@lo:400:kworker.0 00000040:00080000:3.0:1788448490.532161:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448490.592459:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926932096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448490.592537:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448490.592698:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932096 00000100:00100000:2.0:1788448490.592706:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932096 00000100:00100000:2.0:1788448490.592763:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788448490.592773:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926932096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448490.592811:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448490.592871:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926932096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448490.592879:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788448490.592967:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a8359d5880 x1875323926932096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448506 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448490.593015:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926932096:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448491.040796:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448491.958007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448491.958073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448491.958224:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779264 00000100:00100000:3.0:1788448491.958239:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779264 00000100:00100000:3.0:1788448491.958295:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 280 00000100:00100000:3.0:1788448491.958306:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902779264:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448491.958387:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902779264:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 83us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448491.958395:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 280 00000100:00100000:1.0:1788448491.959511:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779392 00000100:00100000:1.0:1788448491.959522:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779392 00000100:00100000:1.0:1788448491.959607:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:1.0:1788448491.959618:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902779392:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448491.959681:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902779392:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 66us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448491.959689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00080000:0.0:1788448491.961315:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448491.971936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448491.972026:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448491.972122:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779520 00000100:00100000:0.0:1788448491.972122:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779648 00000100:00100000:3.0:1788448491.972134:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779520 00000100:00100000:0.0:1788448491.972134:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779648 00000100:00100000:3.0:1788448491.972248:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1788448491.972253:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:3.0:1788448491.972261:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2351:x1875323902779520:12345-192.168.204.37@tcp:9:kworker.0 00000100:00100000:0.0:1788448491.972268:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902779648:12345-192.168.204.37@tcp:400:kworker.0 00000020:00000080:3.0:1788448491.972295:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90ab00f 00000100:00080000:3.0:1788448491.972304:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a807558000 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788448491.972344:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902779648:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 82us (317us total) trans 0 rc 0/0 00000001:00000004:3.0:1788448491.972348:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:0.0:1788448491.972354:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00080000:1.0:1788448491.972574:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448491.972579:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448491.972984:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+2:2351:x1875323902779520:12345-192.168.204.37@tcp:9:kworker.0 Request processed in 726us (1057us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448491.972992:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00010000:00010000:0.0:1788448491.976141:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448492.065771:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448493.095524:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448493.152818:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926932224:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448493.152901:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448493.153380:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932224 00000100:00100000:3.0:1788448493.153388:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932224 00000100:00100000:3.0:1788448493.153459:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448493.153470:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926932224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448493.153507:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448493.153583:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926932224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448493.153590:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448493.153642:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835421880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926932224:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788448493.154852:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448494.112603:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448495.136517:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448495.200543:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926932352:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.200549:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926932736:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.200570:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926932608:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.200624:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926932480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.200697:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.200705:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.200710:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.200834:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448495.200909:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926932864:0@lo:400:kworker.0 00000100:00100000:2.0:1788448495.200961:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932736 00000100:00100000:2.0:1788448495.200969:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932736 00000100:00100000:0.0:1788448495.201020:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926932992:0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.201084:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448495.201125:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932352 00000100:00100000:0.0:1788448495.201130:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932352 00000100:00100000:1.0:1788448495.201144:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932608 00000100:00100000:3.0:1788448495.201146:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932480 00000100:00100000:1.0:1788448495.201151:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932608 00000100:00100000:3.0:1788448495.201152:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932480 00000100:00100000:0.0:1788448495.201170:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:0.0:1788448495.201211:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926932352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.201217:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448495.201224:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1788448495.201228:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926932480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.201238:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926932608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.201260:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926932352:12345-0@lo:400:kworker.0 Request processed in 81us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448495.201267:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926932480:12345-0@lo:400:kworker.0 Request processed in 45us (490us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.201267:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:3.0:1788448495.201273:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448495.201292:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926932608:12345-0@lo:400:kworker.0 Request processed in 58us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448495.201303:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448495.201303:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788448495.201306:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932992 00000100:00100000:0.0:1788448495.201310:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932992 00000100:00100000:1.0:1788448495.201325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926932864 00000100:00100000:1.0:1788448495.201329:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926932864 00000100:00100000:0.0:1788448495.201343:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788448495.201352:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926932992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.201362:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788448495.201381:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926932864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448495.201402:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926932992:12345-0@lo:400:kworker.0 Request processed in 51us (357us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448495.201410:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448495.201427:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926932864:12345-0@lo:400:kworker.0 Request processed in 47us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448495.201434:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:1.0:1788448495.201454:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448495.201459:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448495.201468:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926932480:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.201479:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926932352:0@lo:400:kworker.0 00000100:00100000:1.0:1788448495.201483:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926932608:0@lo:400:kworker.0 00010000:00080000:0.0:1788448495.201486:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835afd180 x1875323926932992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448495.201497:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926932992:0@lo:400:kworker.0 00000100:00100000:3.0:1788448495.201516:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926932864:0@lo:400:kworker.0 00000100:00100000:2.0:1788448495.201609:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1788448495.201612:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448495.201619:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926932736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448495.201668:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926932736:12345-0@lo:400:kworker.0 Request processed in 51us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448495.201674:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788448495.201728:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926932736:0@lo:400:kworker.0 00000100:00100000:2.0:1788448495.715102:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926933120:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448495.715233:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448495.715575:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933120 00000100:00100000:3.0:1788448495.715585:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933120 00000100:00100000:3.0:1788448495.715640:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788448495.715652:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926933120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448495.715687:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448495.715779:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926933120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448495.715786:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1788448495.715849:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a835afdc00 x1875323926933120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448511 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448495.715868:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926933120:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448496.162101:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448496.782932:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:3.0:1788448496.782953:0:6707:0:(genops.c:885:class_export_put()) final put ffff99a80755c800/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:1.0:1788448496.783033:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80755c800/af250c24-64ec-487b-a1ec-11a62017775a for lustre-OST0000 00000020:00000080:1.0:1788448496.783091:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a807558000 for lustre-OST0000 00000100:00100000:2.0:1788448497.079406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448497.079453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448497.079500:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448497.079793:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780032 00000100:00100000:0.0:1788448497.079805:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780032 00000100:00100000:0.0:1788448497.079882:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779904 00000100:00100000:0.0:1788448497.079885:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779904 00000100:00100000:0.0:1788448497.079911:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:0.0:1788448497.079923:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902780032:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448497.080026:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902780032:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 105us (572us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448497.080034:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:0.0:1788448497.080053:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:0.0:1788448497.080059:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902779904:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448497.080095:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902779904:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 37us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448497.080101:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:3.0:1788448497.080534:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902779776 00000100:00100000:3.0:1788448497.080539:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902779776 00000100:00100000:3.0:1788448497.080570:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 282 00000100:00100000:3.0:1788448497.080577:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902779776:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448497.080613:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902779776:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 36us (1221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448497.080620:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 282 00000100:00080000:2.0:1788448497.081284:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788448497.184473:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448498.208271:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448498.272410:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926933248:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448498.272498:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448498.275335:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933248 00000100:00100000:0.0:1788448498.275348:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933248 00000100:00100000:0.0:1788448498.275465:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448498.275483:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926933248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448498.275520:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788448498.275615:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448498.275980:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926933248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 498us (3480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448498.275988:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448498.279492:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926933248:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788448499.238387:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448500.256375:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448500.322089:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926933376:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.322089:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926933504:0@lo:400:kworker.0 00000100:00100000:2.0:1788448500.322133:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926933632:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.322167:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926933760:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.324613:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448500.324661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933504 00000100:00100000:1.0:1788448500.324661:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448500.324673:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933504 00000100:00100000:1.0:1788448500.324696:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448500.324703:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926934016:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.324704:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926933888:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.324730:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448500.324730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448500.324864:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933888 00000100:00100000:2.0:1788448500.324869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933888 00000100:00100000:2.0:1788448500.324900:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788448500.324909:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926933504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448500.325035:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926933504:12345-0@lo:400:kworker.0 Request processed in 127us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448500.325042:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788448500.325060:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788448500.325067:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926933888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448500.328102:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926933888:12345-0@lo:400:kworker.0 Request processed in 3026us (3362us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448500.328119:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788448500.328207:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448500.329545:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448500.331139:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926933888:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331202:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933760 00000100:00100000:1.0:1788448500.331210:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933760 00000100:00100000:1.0:1788448500.331451:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934016 00000100:00100000:1.0:1788448500.331456:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934016 00000100:00100000:1.0:1788448500.331479:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448500.331489:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926933760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331603:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926933760:12345-0@lo:400:kworker.0 Request processed in 104us (6930us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448500.331612:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448500.331629:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448500.331635:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926934016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331665:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926934016:12345-0@lo:400:kworker.0 Request processed in 30us (6934us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448500.331671:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448500.331690:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933632 00000100:00100000:1.0:1788448500.331694:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933632 00000100:00100000:1.0:1788448500.331716:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448500.331723:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926933632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331756:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926933632:12345-0@lo:400:kworker.0 Request processed in 34us (3549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448500.331762:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1788448500.331795:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926933760:0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926933376 00000100:00100000:1.0:1788448500.331854:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926933376 00000100:00100000:1.0:1788448500.331881:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:1.0:1788448500.331888:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926933376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448500.331917:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926933376:12345-0@lo:400:kworker.0 Request processed in 30us (2377us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448500.331923:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00080000:1.0:1788448500.331960:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788448500.332476:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a834f76300 x1875323926934016/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448516 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448500.332489:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f76300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926934016:0@lo:400:kworker.0 00000100:00100000:0.0:1788448500.332503:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926933504:0@lo:400:kworker.0 00000100:00100000:2.0:1788448500.332650:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926933632:0@lo:400:kworker.0 00000100:00080000:1.0:1788448500.332671:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448500.332673:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448500.335211:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926933376:0@lo:400:kworker.0 00000040:00080000:0.0:1788448500.770539:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448500.833353:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448500.833376:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926934144:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448500.833516:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448500.833579:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934144 00000100:00100000:0.0:1788448500.833588:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934144 00000100:00100000:0.0:1788448500.833642:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448500.833653:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926934144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448500.833688:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448500.833755:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926934144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448500.833762:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788448500.833774:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce36a00 x1875323926934144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448516 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448500.833809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926934144:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1788448501.239813:0:11845:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 11:14:58 (1788448498) 00010000:00010000:1.0:1788448501.281674:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448502.196954:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448502.197807:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448502.197848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448502.198451:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780288 00000100:00100000:1.0:1788448502.198468:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780288 00000100:00100000:1.0:1788448502.199773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780416 00000100:00100000:1.0:1788448502.199785:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780416 00000100:00100000:1.0:1788448502.199823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:1.0:1788448502.199835:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902780288:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448502.199947:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902780288:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 114us (3008us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448502.199955:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00080000:2.0:1788448502.200127:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448502.200229:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780160 00000100:00100000:0.0:1788448502.200236:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780160 00000100:00100000:0.0:1788448502.200312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 284 00000100:00100000:0.0:1788448502.200321:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902780160:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448502.200357:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902780160:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 39us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448502.200362:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:0.0:1788448502.200381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 284 00000100:00100000:2.0:1788448502.200390:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902780416:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448502.200430:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902780416:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 45us (2581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448502.200447:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00010000:00010000:2.0:1788448502.306780:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448503.329048:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448503.392536:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448503.400460:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926934272:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448503.400618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448503.402582:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934272 00000100:00100000:0.0:1788448503.402595:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934272 00000100:00100000:0.0:1788448503.402694:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00080000:2.0:1788448503.402766:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448503.402987:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926934272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448503.403039:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448503.403124:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926934272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448503.403162:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926934272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448503.416431:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788448503.482734:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448503.483360:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780544 00000100:00100000:2.0:1788448503.483379:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780544 00000100:00100000:2.0:1788448503.483491:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:2.0:1788448503.483505:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:10226:x1875323902780544:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448503.483536:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448503.483671:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab0da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109ef expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.483770:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.483790:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.483807:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448503.483859:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448503.483864:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448503.483915:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.483948:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab0da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109ef expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.484171:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109ef expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.484183:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04200) 00010000:00010000:2.0:1788448503.484723:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448503.484728:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:3.0:1788448503.493830:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:10226:x1875323902780544:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 10306us (11092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448503.493847:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:0.0:1788448503.505361:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448503.506508:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780672 00000100:00100000:3.0:1788448503.506527:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780672 00000100:00100000:1.0:1788448503.506725:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:1.0:1788448503.506742:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:10227:x1875323902780672:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448503.506775:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448503.506807:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab0e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109f6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.506911:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.506929:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.506943:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.506963:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.506971:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507008:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507353:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507363:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507371:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448503.507409:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788448503.507413:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448503.507442:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507455:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507463:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507471:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507478:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448503.507483:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507492:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507515:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04200) 00010000:00010000:1.0:1788448503.507518:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448503.507524:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507531:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab0ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507547:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507553:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507561:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507567:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448503.507570:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507578:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507586:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99a808bbff00) 00010000:00010000:1.0:1788448503.507589:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448503.507592:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.507599:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab0f6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.508662:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab0e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109f6 expref: 8 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.508683:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109f6 expref: 7 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448503.508693:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448503.508696:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448503.508700:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9ca00, rc 0) 00000100:00100000:1.0:1788448503.508805:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:10227:x1875323902780672:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2067us (3470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448503.508816:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1788448503.515312:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448503.515570:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902780928 00000100:00100000:3.0:1788448503.515584:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902780928 00000100:00100000:3.0:1788448503.515673:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:3.0:1788448503.515686:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:10227:x1875323902780928:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448503.515716:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448503.515744:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab104 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba05109fd expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515847:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515864:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515879:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515899:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515906:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448503.515932:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.520943:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab119 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521048:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521068:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab119 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448503.521085:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1788448503.521706:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521717:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521725:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521733:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448503.521738:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521769:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521787:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:2.0:1788448503.521791:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448503.521797:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521805:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab10b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521824:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521831:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521838:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521844:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448503.521847:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521854:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521862:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a829674900) 00010000:00010000:2.0:1788448503.521865:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448503.521868:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.521884:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab112 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.523558:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab104 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109fd expref: 10 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.523717:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab119 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109fd expref: 9 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448503.523727:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:2.0:1788448503.523730:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448503.523733:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178400, rc 0) 00000100:00100000:2.0:1788448503.523900:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:10227:x1875323902780928:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 8215us (8603us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1788448503.523912:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:2.0:1788448503.557088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448503.557305:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781056 00000100:00100000:3.0:1788448503.557320:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781056 00000100:00100000:3.0:1788448503.557477:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:3.0:1788448503.557493:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:10227:x1875323902781056:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1788448503.557651:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:10227:x1875323902781056:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 163us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448503.557659:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000040:00080000:2.0:1788448503.841044:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448504.376561:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448505.389824:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448505.459953:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460079:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460161:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788448505.460169:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926934400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460249:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460273:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926934912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460298:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460339:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926934528:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460363:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460378:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926935040:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460396:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460413:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448505.460612:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926934656:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.460643:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448505.460890:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934784 00000100:00100000:3.0:1788448505.460901:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934784 00000100:00100000:3.0:1788448505.460974:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926935040 00000100:00100000:3.0:1788448505.460978:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926935040 00000100:00100000:3.0:1788448505.460997:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448505.461005:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926934784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.461069:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926934784:12345-0@lo:400:kworker.0 Request processed in 64us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.461076:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448505.461099:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448505.461105:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926935040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.461138:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926935040:12345-0@lo:400:kworker.0 Request processed in 33us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.461143:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448505.461163:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934400 00000100:00100000:3.0:1788448505.461167:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934400 00000100:00100000:3.0:1788448505.461218:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1788448505.461224:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926934400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.461253:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926934400:12345-0@lo:400:kworker.0 Request processed in 30us (1004us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448505.461258:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:0.0:1788448505.461331:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448505.461336:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448505.469790:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934912 00000100:00100000:1.0:1788448505.469816:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934912 00000100:00100000:1.0:1788448505.469929:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934528 00000100:00100000:1.0:1788448505.469934:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934528 00000100:00100000:1.0:1788448505.469952:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926934656 00000100:00100000:1.0:1788448505.469955:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926934656 00000100:00100000:1.0:1788448505.469981:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788448505.469992:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926934912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.470116:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926934912:12345-0@lo:400:kworker.0 Request processed in 126us (9815us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448505.470124:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788448505.470147:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448505.470153:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926934528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.470204:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926934528:12345-0@lo:400:kworker.0 Request processed in 32us (9821us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448505.470228:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788448505.470244:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00080000:0.0:1788448505.471978:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448505.476263:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926934656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448505.476459:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926934656:12345-0@lo:400:kworker.0 Request processed in 6203us (15808us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448505.476474:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788448505.482721:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926934400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.482753:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926934912:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.482772:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926934784:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.482864:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926934656:0@lo:400:kworker.0 00000100:00100000:3.0:1788448505.482880:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926934528:0@lo:400:kworker.0 00010000:00080000:3.0:1788448505.482897:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e4a80 x1875323926935040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788448521 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448505.482910:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926935040:0@lo:400:kworker.0 00000100:00100000:2.0:1788448505.953484:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926935168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448505.953581:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448505.953716:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926935168 00000100:00100000:0.0:1788448505.953726:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926935168 00000100:00100000:0.0:1788448505.953793:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788448505.953805:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926935168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448505.953853:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448505.953922:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f75180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926935168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448505.953930:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:0.0:1788448505.954112:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83ce34700 x1875323926935168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448521 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448505.954142:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926935168:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448506.306359:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448506.307466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781184 00000100:00100000:2.0:1788448506.307484:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781184 00000100:00100000:2.0:1788448506.307594:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1788448506.307610:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:10270:x1875323902781184:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448506.307644:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448506.307674:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab127 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a04 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307786:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307803:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307820:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307836:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307843:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.307849:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788448506.308300:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448506.308309:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308320:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308327:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308334:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448506.308340:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308506:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308526:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04200) 00010000:00010000:2.0:1788448506.308530:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448506.308536:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308544:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab12e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308561:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308568:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308574:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308580:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448506.308583:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308590:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308598:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a804d04100) 00010000:00010000:2.0:1788448506.308601:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448506.308604:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308621:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab135 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308671:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab127 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a04 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308684:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04200) 00010000:00010000:2.0:1788448506.308686:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448506.308690:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab127 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a04 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.308702:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179e00, rc 0) 00000100:00100000:2.0:1788448506.308809:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:10270:x1875323902781184:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1204us (2463us total) trans 0 rc 301/301 00000100:00100000:2.0:1788448506.308818:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1788448506.318339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.318798:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781440 00000100:00100000:3.0:1788448506.318818:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781440 00000100:00100000:3.0:1788448506.318918:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1788448506.318934:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:10270:x1875323902781440:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:3.0:1788448506.319033:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448506.319069:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab0e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109ef expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.319095:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04200) 00010000:00010000:3.0:1788448506.319107:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448506.319978:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.319998:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.320011:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.320023:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.320043:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.320050:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448506.330128:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788448506.330154:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330167:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330175:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330182:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448506.330212:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330221:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330244:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674100) 00010000:00010000:0.0:1788448506.330248:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448506.330253:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.330260:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab13c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448506.330298:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a0588f reply state 000000003a1fae4f transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448506.330333:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448506.330496:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+10:10270:x1875323902781440:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 11560us (12166us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788448506.330507:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00010000:00010000:1.0:1788448506.334070:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334092:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334101:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334107:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448506.334113:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334122:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334143:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a829674e00) 00010000:00010000:1.0:1788448506.334146:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448506.334151:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.334157:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab143 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.405602:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448506.461074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.461269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781568 00000100:00100000:3.0:1788448506.461295:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781568 00000100:00100000:3.0:1788448506.461365:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:3.0:1788448506.461378:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:10278:x1875323902781568:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:3.0:1788448506.461524:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448506.461560:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab14a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a0b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461651:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461669:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461684:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448506.461732:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448506.461736:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448506.461784:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461820:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab14a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a0b expref: 11 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461864:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a0b expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.461876:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448506.461879:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448506.461883:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246e00, rc 0) 00000100:00100000:3.0:1788448506.462255:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:10278:x1875323902781568:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 878us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.462277:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:2.0:1788448506.538121:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.538241:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781696 00000100:00100000:0.0:1788448506.538256:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781696 00000100:00100000:0.0:1788448506.538348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1788448506.538361:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+10:10284:x1875323902781696:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448506.538388:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448506.538426:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab158 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a12 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538518:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538637:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538653:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538675:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538683:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538690:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538841:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538850:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538858:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448506.538891:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1788448506.538896:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448506.538944:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538958:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538965:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538972:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538978:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448506.538984:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.538992:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539007:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:0.0:1788448506.539016:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448506.539023:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539031:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab15f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539049:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539055:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539061:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539067:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448506.539070:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539076:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539084:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff99a80bd82900) 00010000:00010000:0.0:1788448506.539087:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448506.539089:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539095:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab166 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539133:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab158 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a12 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539160:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a12 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.539168:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448506.539171:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788448506.539173:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec800, rc 0) 00000100:00100000:2.0:1788448506.539795:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+11:10284:x1875323902781696:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1430us (1685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448506.539807:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:2.0:1788448506.544071:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.544343:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902781952 00000100:00100000:3.0:1788448506.544357:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902781952 00000100:00100000:3.0:1788448506.544446:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:3.0:1788448506.544459:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+11:10284:x1875323902781952:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448506.544488:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448506.544517:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab174 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a19 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.544690:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.544707:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.544720:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.545009:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.545047:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.545061:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448506.545890:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1788448506.546106:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546118:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546126:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546163:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546170:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546177:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546182:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448506.546232:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546241:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546268:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448506.546272:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448506.546278:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.546293:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab17b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448506.546311:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003d2d2de2 reply state 00000000741ff11a transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.546324:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788448506.546557:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab174 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.546587:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.546610:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:2.0:1788448506.546614:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448506.546617:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247800, rc 0) 00000100:00100000:2.0:1788448506.546730:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:10284:x1875323902781952:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2273us (2674us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788448506.546742:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:1.0:1788448506.552912:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.553018:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782080 00000100:00100000:3.0:1788448506.553034:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782080 00000100:00100000:3.0:1788448506.553257:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1788448506.553266:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902782080:12345-192.168.204.37@tcp:8:bash.0 00010000:00080000:3.0:1788448506.553314:0:6683:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 367 last 0 00000020:00000080:3.0:1788448506.553347:0:6683:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90ab197 00002000:00100000:3.0:1788448506.553360:0:6683:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli af250c24-64ec-487b-a1ec-11a62017775a/ffff99a80890e800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788448506.553372:0:6683:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788448506.553787:0:6683:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788448506.553824:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a80890d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448506.553905:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902782080:12345-192.168.204.37@tcp:8:bash.0 Request processed in 637us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.553915:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:2.0:1788448506.560482:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.560631:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782208 00000100:00100000:3.0:1788448506.560647:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782208 00000100:00100000:3.0:1788448506.560763:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448506.560773:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:0:x1875323902782208:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448506.560791:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448506.560815:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a20 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448506.560843:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448506.560862:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=367s v=(0 0) 00010000:00010000:3.0:1788448506.560867:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448506.560877:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.560897:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.560911:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:3.0:1788448506.560973:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:0:x1875323902782208:12345-192.168.204.37@tcp:101:bash.0 Request processed in 201us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.560980:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00080000:2.0:1788448506.563246:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448506.565873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:0.0:1788448506.565971:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.565992:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.566002:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.566004:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782336 00010000:00010000:0.0:1788448506.566015:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247200 already unused, calling callback (ffffffffc206d4f0) 00000100:00100000:3.0:1788448506.566024:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782336 00010000:00010000:0.0:1788448506.566025:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.566041:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.566066:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674300) 00010000:00010000:0.0:1788448506.566069:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448506.566075:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.566095:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab182 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.566108:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1788448506.566121:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:10284:x1875323902782336:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448506.566152:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448506.566175:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a27 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.566258:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.566267:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448506.566271:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448506.566277:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.566335:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.566357:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.566377:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a810d6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926935296:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448506.566483:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448506.571812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.571900:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782464 00000100:00100000:0.0:1788448506.571919:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782464 00000100:00100000:1.0:1788448506.572210:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a810d6e680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926935296:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448506.572251:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.572274:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00010000:00010000:0.0:1788448506.572334:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 9 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448506.572352:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:10284:x1875323902782336:12345-192.168.204.37@tcp:101:bash.0 Request processed in 6226us (6483us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448506.572364:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1788448506.572410:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:0.0:1788448506.572426:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902782464:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448506.572447:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448506.572479:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.572497:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.572532:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab19e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a20 expref: 8 pid: 6682 timeout: 467 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.572555:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448506.572561:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448506.572583:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.572595:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.572673:0:6696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448506.572690:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6696:1875323926935424:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448506.572785:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8297d4540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448506.578588:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce34a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6696:1875323926935424:192.168.204.37@tcp:105: 00010000:00010000:0.0:1788448506.578624:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448506.578706:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902782464:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 6283us (6902us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448506.578719:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:2.0:1788448506.582475:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.582613:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782720 00000100:00100000:0.0:1788448506.582628:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782720 00000100:00100000:0.0:1788448506.582748:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1788448506.582762:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+13:10284:x1875323902782720:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1788448506.583439:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+14:10284:x1875323902782720:12345-192.168.204.37@tcp:35:bash.0 Request processed in 675us (1043us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1788448506.583449:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1788448506.677562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.677714:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902782976 00000100:00100000:0.0:1788448506.677728:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902782976 00000100:00100000:0.0:1788448506.677809:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:0.0:1788448506.677824:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+14:10294:x1875323902782976:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448506.677857:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448506.677882:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab1ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a2e expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448506.678023:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1788448506.678181:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab1ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a2e expref: 16 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.678254:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:0.0:1788448506.678257:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448506.678264:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab1ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a2e expref: 16 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.678291:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed400, rc 0) 00000100:00100000:0.0:1788448506.678379:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+15:10294:x1875323902782976:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 558us (833us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1788448506.678387:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:1.0:1788448506.683006:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.683141:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902783232 00000100:00100000:3.0:1788448506.683155:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902783232 00000100:00100000:3.0:1788448506.683288:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1788448506.683301:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+15:10294:x1875323902783232:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448506.684554:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:10294:x1875323902783232:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1246us (1553us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788448506.684584:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1788448506.827076:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448506.832851:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902783360 00000100:00100000:2.0:1788448506.832874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902783360 00000100:00100000:2.0:1788448506.833170:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1788448506.833205:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:10300:x1875323902783360:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448506.833239:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448506.833268:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab1ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a35 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833382:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833399:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833444:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448506.833493:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788448506.833497:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448506.833531:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833564:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab1ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a35 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833588:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a35 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.833598:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:2.0:1788448506.833602:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448506.833607:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:2.0:1788448506.833694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+17:10300:x1875323902783360:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 512us (6632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448506.833704:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:0.0:1788448506.843271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448506.843788:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902783616 00000100:00100000:2.0:1788448506.843802:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902783616 00000100:00100000:2.0:1788448506.844398:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:2.0:1788448506.844427:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+17:10300:x1875323902783616:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448506.844462:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448506.844490:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab1c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a3c expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.844671:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab1cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.844691:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.844706:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab1cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448506.844720:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788448506.844906:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab1c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a3c expref: 20 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.844929:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab1cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a3c expref: 19 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448506.844938:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:2.0:1788448506.844942:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448506.844946:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179200, rc 0) 00000100:00100000:2.0:1788448506.845034:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:10300:x1875323902783616:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 624us (1779us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1788448506.845042:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:1.0:1788448506.851655:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.852103:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902783744 00000100:00100000:0.0:1788448506.852117:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902783744 00000100:00100000:1.0:1788448506.852986:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:1.0:1788448506.853004:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+19:2355:x1875323902783744:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448506.853027:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448506.853063:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab1cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a3c expref: 19 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448506.853089:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:1.0:1788448506.853096:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448506.853204:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+18:2355:x1875323902783744:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 206us (1564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448506.853215:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1788448506.869838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448506.874815:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784000 00000100:00100000:2.0:1788448506.874835:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784000 00000100:00100000:0.0:1788448506.876470:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1788448506.876488:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:10300:x1875323902784000:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448506.876528:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448506.876561:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1dd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a43 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.876711:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.876756:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.876853:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448506.876874:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1788448506.877069:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1dd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a43 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.877094:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a43 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.877104:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:0.0:1788448506.877107:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788448506.877112:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed000, rc 0) 00000100:00100000:0.0:1788448506.877247:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+20:10300:x1875323902784000:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 762us (7422us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788448506.877256:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1788448506.895735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.899666:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784128 00000100:00100000:3.0:1788448506.899689:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784128 00000100:00100000:3.0:1788448506.901023:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1788448506.901048:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902784128:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:3.0:1788448506.901110:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.901135:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.901146:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448506.901214:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448506.901220:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.901272:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.901304:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 7 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.901399:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a810d6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875323926935552:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448506.901545:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a839ac7840 going to sleep for 11 seconds 00000100:00100000:3.0:1788448506.920740:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a810d6c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875323926935552:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448506.920784:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448506.922857:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448506.923018:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784256 00000100:00100000:0.0:1788448506.923030:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784256 00002000:00100000:0.0:1788448506.923079:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99a83fc64700 x1875323902784256/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:742/0 lens 504/0 e 0 to 0 dl 1788448517 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448506.923091:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc64700 with x1875323902784256 ext(0->12) 00010000:00010000:0.0:1788448506.923102:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 8 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448506.923132:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 8 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448506.923142:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a83fc64700 00000100:00100000:0.0:1788448506.923337:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448506.923350:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902784256:12345-192.168.204.37@tcp:4:lfs.0 00000001:00100000:1.0:1788448506.976007:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000100:00100000:3.0:1788448506.976843:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902784256:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 53490us (53992us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788448506.976865:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00002000:00100000:3.0:1788448506.976877:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff99a83fc64700 x1875323902784256/t4294967299(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:742/0 lens 504/448 e 0 to 0 dl 1788448517 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448506.976887:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc64700 with x1875323902784256 ext(0->12) 00010000:00010000:3.0:1788448506.976898:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.976916:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448506.976924:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a83fc64700 00000100:00100000:1.0:1788448506.980215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448506.986293:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784384 00000100:00100000:3.0:1788448506.986306:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784384 00010000:00010000:3.0:1788448506.986355:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.986408:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:3.0:1788448506.986417:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2354:x1875323902784384:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448506.986432:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788448506.986453:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1788448506.986456:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1788448505 00002000:00010000:3.0:1788448506.986458:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1788448505 00002000:00010000:3.0:1788448506.986460:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1788448505 00010000:00010000:3.0:1788448506.986467:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986501:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986524:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f191a44d/0xd0e9b344b90ab1a5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a27 expref: 9 pid: 6683 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986540:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448506.986544:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448506.986550:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986559:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986599:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448506.986656:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:2354:x1875323902784384:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 241us (6470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.986664:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00010000:00010000:3.0:1788448506.986692:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986700:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986722:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986736:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986754:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986761:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448506.986765:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986773:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986784:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448506.986791:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab1f2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448506.986833:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902784128:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 85798us (91115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448506.986839:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:0.0:1788448507.003181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.003255:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784640 00000100:00100000:0.0:1788448507.003266:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784640 00000100:00100000:0.0:1788448507.003331:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448507.003342:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:10300:x1875323902784640:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:0.0:1788448507.003425:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a43 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448507.003824:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1788448507.003902:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1788448507.004514:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1788448507.004581:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.004599:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.004609:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.004665:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.004681:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 24 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448507.004696:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875323926935680:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448507.004786:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80133ae40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448507.013444:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875323926935680:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448507.013475:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448507.023042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.023676:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784768 00000100:00100000:0.0:1788448507.023686:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784768 00010000:00010000:0.0:1788448507.023735:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 25 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448507.023977:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:0.0:1788448507.023988:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+25:2353:x1875323902784768:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448507.024002:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448507.024009:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 25 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024022:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 25 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024045:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab189 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a19 expref: 25 pid: 5839 timeout: 467 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024080:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:0.0:1788448507.024085:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024095:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024103:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.024129:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448507.024469:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.024479:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448507.024814:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000100:00100000:0.0:1788448507.026077:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+25:2353:x1875323902784768:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 2083us (3042us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448507.026089:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000001:00080000:1.0:1788448507.027436:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1788448507.028447:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926935808:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788448507.028838:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448507.028876:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448507.028958:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926935808 00000100:00100000:2.0:1788448507.028966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926935808 00000100:00080000:3.0:1788448507.029024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448507.029035:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448507.029054:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926935808:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788448507.029144:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926935808:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 82us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448507.029153:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448507.029473:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926935808:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788448507.030408:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1788448507.030487:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a810d6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926935936:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448507.030539:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448507.030563:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809018a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448507.030778:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926935936 00000100:00100000:3.0:1788448507.030783:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926935936 00000100:00100000:3.0:1788448507.030816:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448507.030825:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926935936:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448507.031254:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875323926935936:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 429us (714us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788448507.031262:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448507.031311:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a810d6c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926935936:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788448507.031371:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1788448507.031405:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031416:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031423:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031429:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448507.031434:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031441:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031467:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:3.0:1788448507.031470:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788448507.031475:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.031481:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab1f9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448507.031653:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788448507.031846:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:3.0:1788448507.031857:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367638670490ns, next at 368638668728ns, rc = 0 00000001:00080000:3.0:1788448507.031864:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:3.0:1788448507.031906:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674b00) 00010000:00010000:3.0:1788448507.031909:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788448507.031916:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab1e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a43 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448507.032023:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+27:10300:x1875323902784640:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 28682us (28849us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788448507.032403:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000020:00080000:3.0:1788448507.032408:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788448507.035787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.036180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902784896 00000100:00100000:1.0:1788448507.036216:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902784896 00000100:00100000:1.0:1788448507.036286:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448507.036298:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+27:10300:x1875323902784896:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448507.036324:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448507.036354:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab200 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a4a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.036420:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a4a expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.036436:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab200 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a4a expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.036474:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448507.036478:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448507.036482:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d000, rc 0) 00000100:00100000:1.0:1788448507.036543:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:10300:x1875323902784896:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 247us (765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448507.036550:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:0.0:1788448507.045382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448507.045706:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902785152 00000100:00100000:2.0:1788448507.045716:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902785152 00000100:00100000:2.0:1788448507.045769:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1788448507.045779:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+28:10300:x1875323902785152:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448507.046029:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace1050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:10300:x1875323902785152:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 251us (655us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1788448507.046037:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000001:00080000:3.0:1788448507.047457:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967316 is committed 00000100:00100000:3.0:1788448507.153755:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448507.154116:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902785408 00000100:00100000:2.0:1788448507.154127:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902785408 00000100:00100000:2.0:1788448507.154256:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:2.0:1788448507.154278:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+21:10310:x1875323902785408:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448507.154306:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448507.154328:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a51 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448507.154423:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788448507.154565:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab207 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a51 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.154582:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:2.0:1788448507.154585:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448507.154590:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a51 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.154625:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179e00, rc 0) 00000100:00100000:2.0:1788448507.154694:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+22:10310:x1875323902785408:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 429us (951us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1788448507.154703:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1788448507.160836:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448507.160926:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902785536 00000100:00100000:2.0:1788448507.160938:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902785536 00000100:00100000:2.0:1788448507.161069:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:2.0:1788448507.161080:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+22:10310:x1875323902785536:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:2.0:1788448507.161161:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161179:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161231:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161249:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161257:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161263:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161568:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161589:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161598:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448507.161641:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161654:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161661:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161668:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161674:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448507.161678:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161685:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161699:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:2.0:1788448507.161701:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448507.161706:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161711:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab215 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161732:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161737:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161742:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161748:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448507.161750:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161756:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161763:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a804d04100) 00010000:00010000:2.0:1788448507.161766:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448507.161768:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161773:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab21c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161787:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161794:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161799:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161809:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448507.161813:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161819:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161826:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448507.161828:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448507.161831:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.161836:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab223 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448507.161909:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+22:10310:x1875323902785536:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 830us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448507.161917:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:3.0:1788448507.165467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.165572:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902785792 00000100:00100000:0.0:1788448507.165582:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902785792 00000100:00100000:0.0:1788448507.165646:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1788448507.165657:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+22:10310:x1875323902785792:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448507.165900:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:10310:x1875323902785792:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 244us (442us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1788448507.165907:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1788448507.236126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448507.236241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786048 00000100:00100000:2.0:1788448507.236252:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786048 00000100:00100000:2.0:1788448507.236316:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:2.0:1788448507.236327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:10313:x1875323902786048:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448507.236352:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448507.236375:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab22a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a58 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236629:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236795:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236871:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236890:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236899:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.236905:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.237175:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.237863:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.237878:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448507.237892:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788448507.238004:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238012:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238019:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238034:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448507.238038:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238045:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238057:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:2.0:1788448507.238060:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448507.238065:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238071:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab231 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238086:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238092:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238097:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238101:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448507.238104:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238110:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238129:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a804d04100) 00010000:00010000:2.0:1788448507.238131:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448507.238134:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238140:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab238 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238237:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab22a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 26 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238253:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.238261:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448507.238263:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448507.238266:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246c00, rc 0) 00000100:00100000:2.0:1788448507.238358:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+25:10313:x1875323902786048:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2032us (2241us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1788448507.238367:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:1.0:1788448507.248688:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448507.248864:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786176 00000100:00100000:3.0:1788448507.248873:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786176 00000100:00100000:3.0:1788448507.248950:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1788448507.248960:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+25:10313:x1875323902786176:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1788448507.249030:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249046:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249057:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249083:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249090:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249097:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249102:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448507.249106:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249113:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249125:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:3.0:1788448507.249139:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448507.249144:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.249168:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab24d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448507.249279:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+25:10313:x1875323902786176:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 319us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448507.249289:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1788448507.252874:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.257640:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786432 00000100:00100000:0.0:1788448507.257655:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786432 00000100:00100000:0.0:1788448507.257770:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1788448507.257780:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+25:10313:x1875323902786432:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448507.258036:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:10313:x1875323902786432:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 256us (5170us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788448507.258043:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1788448507.324008:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.324063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.324111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.324228:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786560 00000100:00100000:0.0:1788448507.324239:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786560 00000100:00100000:3.0:1788448507.324242:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786688 00000100:00100000:3.0:1788448507.324250:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786688 00000100:00100000:0.0:1788448507.324312:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 286 00000100:00100000:3.0:1788448507.324313:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:0.0:1788448507.324326:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902786560:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448507.324328:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2355:x1875323902786688:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448507.324414:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2355:x1875323902786688:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 91us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448507.324423:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:2.0:1788448507.324479:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902786816 00000100:00100000:2.0:1788448507.324484:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902786816 00000100:00080000:1.0:1788448507.324563:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448507.324603:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:2.0:1788448507.324612:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902786816:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448507.329726:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a839ac2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902786560:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 5391us (5714us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448507.329742:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 286 00000100:00100000:2.0:1788448507.333468:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902786816:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 8845us (9391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448507.333486:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 128 00010000:00010000:1.0:1788448507.425031:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448507.683132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448507.683327:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902787072 00000100:00100000:3.0:1788448507.683336:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902787072 00000100:00100000:3.0:1788448507.683397:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1788448507.683407:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+26:10344:x1875323902787072:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:3.0:1788448507.683433:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448507.683453:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab254 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a5f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.683548:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab25b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.683563:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.683605:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab25b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448507.683617:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788448507.683772:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab254 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a5f expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.683789:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab25b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a5f expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448507.683798:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:3.0:1788448507.683802:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448507.683805:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628c00, rc 0) 00000100:00100000:3.0:1788448507.684316:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:10344:x1875323902787072:12345-192.168.204.37@tcp:101:cat.0 Request processed in 908us (1202us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1788448507.684324:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1788448507.687900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.688112:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902787328 00000100:00100000:1.0:1788448507.688131:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902787328 00000100:00100000:1.0:1788448507.688220:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1788448507.688233:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:10344:x1875323902787328:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:1.0:1788448507.688506:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+29:10344:x1875323902787328:12345-192.168.204.37@tcp:35:cat.0 Request processed in 276us (615us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1788448507.688514:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1788448507.693288:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448507.693707:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902787456 00000100:00100000:2.0:1788448507.693718:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902787456 00000100:00100000:2.0:1788448507.693788:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:2.0:1788448507.693799:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804614c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:2353:x1875323902787456:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448507.693815:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448507.693840:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab25b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a5f expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.693956:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448507.693961:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448507.694876:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804614c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+28:2353:x1875323902787456:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 1074us (1592us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448507.694885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:3.0:1788448507.794716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448507.796132:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902787712 00000100:00100000:0.0:1788448507.796146:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902787712 00000100:00100000:0.0:1788448507.796242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1788448507.796254:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+28:10350:x1875323902787712:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:0.0:1788448507.796292:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448507.796295:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448507.796322:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab1c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a35 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796341:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448507.796346:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448507.796360:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab269 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a66 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796459:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796472:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796497:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796532:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448507.796546:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 28 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448507.796560:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926936064:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448507.796667:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808bc5c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448507.799906:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926936064:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448507.799935:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448507.800942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.802151:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902787840 00000100:00100000:1.0:1788448507.802163:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902787840 00010000:00010000:1.0:1788448507.802222:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 29 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448507.802296:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:1.0:1788448507.802307:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+29:2352:x1875323902787840:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448507.802328:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448507.802337:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 29 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802351:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 29 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802396:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab23f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a58 expref: 29 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802413:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448507.802418:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802427:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802436:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.802468:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448507.802528:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:2352:x1875323902787840:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 222us (1589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448507.802536:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00010000:00010000:2.0:1788448507.802861:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.802871:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448507.802891:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788448507.803137:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab269 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.803156:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448507.803165:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448507.803177:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788448507.803181:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed000, rc 0) 00000100:00100000:2.0:1788448507.803366:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+28:10350:x1875323902787712:12345-192.168.204.37@tcp:101:dd.0 Request processed in 7114us (8658us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788448507.803373:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:3.0:1788448507.806652:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448507.807059:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788096 00000100:00100000:1.0:1788448507.807085:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788096 00000100:00100000:1.0:1788448507.807152:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:1.0:1788448507.807164:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:10350:x1875323902788096:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:1.0:1788448507.807610:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.807627:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.807639:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448507.807693:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1788448507.807897:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdd3cc43 reply state 00000000787bac5f transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448507.807907:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448507.808067:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+31:10350:x1875323902788096:12345-192.168.204.37@tcp:36:dd.0 Request processed in 903us (1423us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1788448507.808075:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000020:00080000:1.0:1788448507.808080:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788448507.810485:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810502:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810509:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810515:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9da00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448507.810519:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810544:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810563:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448507.810916:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448507.810924:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448507.810931:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab27e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448508.144055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.144176:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788224 00000100:00100000:2.0:1788448508.144324:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788224 00000100:00080000:1.0:1788448508.144618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448508.145582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:2.0:1788448508.145600:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+30:10364:x1875323902788224:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:2.0:1788448508.145627:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448508.145648:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab285 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a6d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145716:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145730:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145741:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145757:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145765:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.145772:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.146008:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.146019:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.146026:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.146059:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.146075:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 31 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.146089:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926936192:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448508.146219:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448508.150538:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448508.150632:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788480 00000100:00100000:1.0:1788448508.150641:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788480 00000100:00100000:1.0:1788448508.150702:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:1.0:1788448508.150714:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+32:9233:x1875323902788480:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788448508.151055:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+33:9233:x1875323902788480:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 343us (526us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1788448508.151063:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448508.152600:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926936192:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448508.152629:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448508.154084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448508.154478:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788608 00000100:00100000:1.0:1788448508.154488:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788608 00010000:00010000:1.0:1788448508.154531:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 33 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448508.154621:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:1.0:1788448508.154632:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+33:2353:x1875323902788608:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448508.154648:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448508.154667:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 33 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154680:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 33 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154702:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab270 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a66 expref: 33 pid: 5838 timeout: 468 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154719:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448508.154724:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154733:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154740:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.154774:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448508.154829:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+32:2353:x1875323902788608:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 198us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448508.154836:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00010000:00010000:0.0:1788448508.155156:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155164:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448508.155245:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788448508.155259:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448508.155301:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155315:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155337:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155344:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155351:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155357:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448508.155361:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155374:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155384:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448508.155386:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448508.155390:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155396:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab28c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155409:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155415:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155420:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155431:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448508.155434:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155440:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155459:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a804d04100) 00010000:00010000:0.0:1788448508.155462:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448508.155465:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155471:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155505:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab285 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a6d expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155519:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a6d expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.155526:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:0.0:1788448508.155528:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448508.155530:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247800, rc 0) 00000100:00100000:0.0:1788448508.155575:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+31:10364:x1875323902788224:12345-192.168.204.37@tcp:101:stat.0 Request processed in 9981us (11532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448508.155583:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:3.0:1788448508.253066:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.254896:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788864 00000100:00100000:2.0:1788448508.254913:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788864 00000100:00100000:2.0:1788448508.255003:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:2.0:1788448508.255017:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:10370:x1875323902788864:12345-192.168.204.37@tcp:36:truncate.0 00010000:00010000:2.0:1788448508.255091:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448508.255122:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab29a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a6d expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.255166:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448508.255171:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448508.255478:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.255492:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.255501:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448508.255546:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1788448508.255569:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b783e11e reply state 0000000014bb5436 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.255579:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448508.255705:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+33:10370:x1875323902788864:12345-192.168.204.37@tcp:36:truncate.0 Request processed in 691us (2657us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1788448508.255714:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000020:00080000:2.0:1788448508.255719:0:7154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788448508.264886:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264921:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264929:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264935:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448508.264941:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264949:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264967:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:0.0:1788448508.264970:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448508.264975:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.264982:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab2a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.448500:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448508.474564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448508.476166:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902788992 00000100:00100000:0.0:1788448508.476200:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902788992 00000100:00100000:0.0:1788448508.476475:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:0.0:1788448508.476489:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+32:10384:x1875323902788992:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:0.0:1788448508.476525:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448508.476553:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab2a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a74 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476648:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476686:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476701:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476721:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476729:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.476735:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477507:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477519:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477529:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448508.477581:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1788448508.477587:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448508.477614:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477630:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477656:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477663:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477670:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477676:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448508.477682:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477690:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477705:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448508.477708:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448508.477713:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477719:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab2af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477734:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477740:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477745:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477757:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448508.477760:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477765:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477773:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a80bd82900) 00010000:00010000:0.0:1788448508.477775:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448508.477777:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477783:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab2b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477828:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab2a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477843:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.477852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:0.0:1788448508.477854:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448508.477856:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:0.0:1788448508.478122:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+33:10384:x1875323902788992:12345-192.168.204.37@tcp:101:stat.0 Request processed in 1634us (4257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448508.478131:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:0.0:1788448508.512969:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926936320:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448508.513102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448508.513376:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926936320 00000100:00100000:2.0:1788448508.513387:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926936320 00000100:00100000:2.0:1788448508.513479:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788448508.513492:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926936320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448508.513538:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1788448508.513616:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448508.520151:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926936320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6645us (7032us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448508.520222:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788448508.522834:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926936320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448508.573849:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.573982:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902789248 00000100:00100000:2.0:1788448508.573997:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902789248 00000100:00100000:2.0:1788448508.574081:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:2.0:1788448508.574095:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+33:10394:x1875323902789248:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448508.574125:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448508.574152:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a7b expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448508.574497:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788448508.574682:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2c4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a7b expref: 35 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.574703:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:2.0:1788448508.574706:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448508.574713:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a7b expref: 35 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.574738:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247800, rc 0) 00000100:00100000:2.0:1788448508.576082:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+34:10394:x1875323902789248:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1977us (2235us total) trans 4294967339 rc 301/301 00000100:00100000:2.0:1788448508.576095:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1788448508.583715:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448508.584039:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902789504 00000100:00100000:1.0:1788448508.584053:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902789504 00000100:00100000:1.0:1788448508.584135:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448508.584148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+34:10394:x1875323902789504:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448508.585226:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+35:10394:x1875323902789504:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1036us (1694us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788448508.585265:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1788448508.703642:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.703778:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902789760 00000100:00100000:2.0:1788448508.703792:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902789760 00000100:00100000:2.0:1788448508.703878:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:2.0:1788448508.703892:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+35:10400:x1875323902789760:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448508.703937:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448508.703965:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2d2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a82 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.704102:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.704121:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.704131:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.704177:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.704229:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 36 pid: 5838 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.704258:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926936448:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448508.704396:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448508.724862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448508.724977:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902789888 00000100:00100000:3.0:1788448508.724992:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902789888 00010000:00010000:3.0:1788448508.725056:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 37 pid: 5838 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.725057:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926936448:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448508.725092:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448508.725117:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:3.0:1788448508.725130:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+37:2353:x1875323902789888:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448508.725150:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448508.725158:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 37 pid: 5838 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448508.725348:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 37 pid: 5838 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448508.725442:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab2bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a74 expref: 37 pid: 5838 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448508.725463:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:3.0:1788448508.725469:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448508.725483:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448508.725491:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.726272:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448508.726492:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+36:2353:x1875323902789888:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 1226us (1509us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448508.726521:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00010000:00010000:0.0:1788448508.733202:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.733229:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448508.733272:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:0.0:1788448508.734911:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2d2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.734949:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.734961:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:0.0:1788448508.734965:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788448508.734969:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246c00, rc 0) 00000100:00100000:0.0:1788448508.735139:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+36:10400:x1875323902789760:12345-192.168.204.37@tcp:101:bash.0 Request processed in 31249us (31511us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1788448508.735150:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1788448508.754624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448508.754737:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902790144 00000100:00100000:1.0:1788448508.754751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902790144 00000100:00100000:1.0:1788448508.754835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:1.0:1788448508.754847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+36:10400:x1875323902790144:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:1.0:1788448508.755301:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.755324:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.755339:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448508.755429:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1788448508.755460:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004962fb80 reply state 00000000c28f0072 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448508.755469:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448508.755634:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+39:10400:x1875323902790144:12345-192.168.204.37@tcp:36:bash.0 Request processed in 787us (1023us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788448508.755642:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000020:00080000:1.0:1788448508.755649:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788448508.770996:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771022:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771032:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771063:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.771069:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771078:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771115:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448508.771119:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.771125:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.771130:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab2e7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448508.781426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.781584:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902790272 00000100:00100000:2.0:1788448508.781599:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902790272 00000100:00100000:2.0:1788448508.781671:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1788448508.781684:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+38:10400:x1875323902790272:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448508.781717:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448508.781744:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab2ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a89 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.781856:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.781874:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.781883:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.781925:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.781940:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 39 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.781956:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926936576:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448508.782077:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448508.787013:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc65f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926936576:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448508.787076:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448508.790637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.791008:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902790400 00000100:00100000:2.0:1788448508.791022:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902790400 00010000:00010000:2.0:1788448508.791084:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 40 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.791139:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1788448508.791151:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+40:2353:x1875323902790400:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448508.791173:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448508.791182:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 40 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791234:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 40 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791273:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a82 expref: 40 pid: 5839 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791294:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448508.791300:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791311:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791320:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.791390:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448508.791472:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+39:2353:x1875323902790400:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 322us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448508.791481:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00010000:00010000:0.0:1788448508.792076:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.792088:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448508.792163:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1788448508.792170:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448508.792247:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.792294:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab2ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a89 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.792317:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a89 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448508.792326:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:0.0:1788448508.792329:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448508.792331:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247800, rc 0) 00000100:00100000:0.0:1788448508.792395:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+38:10400:x1875323902790272:12345-192.168.204.37@tcp:101:bash.0 Request processed in 10714us (10983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448508.792403:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:0.0:1788448508.796338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448508.796506:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902790656 00000100:00100000:3.0:1788448508.796520:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902790656 00000100:00100000:3.0:1788448508.796592:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448508.796603:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+38:10400:x1875323902790656:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:3.0:1788448508.796891:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace0050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+39:10400:x1875323902790656:12345-192.168.204.37@tcp:35:bash.0 Request processed in 289us (569us total) trans 4294967344 rc 0/0 00000100:00100000:3.0:1788448508.796900:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448508.886128:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.886351:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902790912 00000100:00100000:2.0:1788448508.886376:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902790912 00000100:00100000:2.0:1788448508.886464:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1788448508.886478:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+39:10410:x1875323902790912:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448508.886517:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448508.886546:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a90 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448508.886673:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1788448508.886845:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2fc lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a90 expref: 41 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.886936:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:2.0:1788448508.886940:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448508.886947:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab2fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a90 expref: 41 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.886964:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809246c00, rc 0) 00000100:00100000:2.0:1788448508.887256:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+40:10410:x1875323902790912:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 779us (1141us total) trans 4294967345 rc 301/301 00000100:00100000:2.0:1788448508.887265:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1788448508.912053:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448508.912159:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902791040 00000100:00100000:0.0:1788448508.912173:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902791040 00000100:00100000:1.0:1788448508.912278:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1788448508.912298:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+40:10410:x1875323902791040:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1788448508.912424:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912445:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912459:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912476:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912483:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912497:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912793:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912803:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912810:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448508.912866:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912884:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912891:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912898:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912904:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.912909:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912917:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912932:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448508.912942:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.912949:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912956:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab30a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912973:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912979:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912985:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912990:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.912993:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.912999:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf600) 00010000:00010000:1.0:1788448508.913009:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.913013:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913017:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab311 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913035:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913046:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913052:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913058:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.913061:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913066:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913075:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448508.913077:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.913080:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.913086:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab318 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448508.914222:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+40:10410:x1875323902791040:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 1885us (2140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448508.914254:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:3.0:1788448508.922621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.922725:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902791296 00000100:00100000:2.0:1788448508.922740:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902791296 00000100:00100000:2.0:1788448508.922813:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:2.0:1788448508.922827:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+40:10410:x1875323902791296:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448508.923633:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+41:10410:x1875323902791296:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 804us (1025us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1788448508.923645:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1788448508.985847:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448508.986026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902791552 00000100:00100000:1.0:1788448508.986041:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902791552 00000100:00100000:1.0:1788448508.986274:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:1.0:1788448508.986288:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+41:10413:x1875323902791552:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448508.986325:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448508.986372:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab31f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a97 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986477:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986492:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986506:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986527:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986534:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986541:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986939:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab334 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986951:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.986961:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab334 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448508.986974:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1788448508.987180:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987229:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987247:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987254:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.987259:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987268:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987283:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448508.987287:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.987293:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987299:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab326 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987315:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987321:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987327:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987332:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448508.987342:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987348:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987356:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf600) 00010000:00010000:1.0:1788448508.987359:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448508.987362:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987368:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab32d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987440:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab31f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a97 expref: 44 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987455:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab334 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a97 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448508.987463:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448508.987466:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448508.987468:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c400, rc 0) 00000100:00100000:1.0:1788448508.987710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+43:10413:x1875323902791552:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1423us (1877us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1788448508.987720:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:3.0:1788448508.991902:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448508.991953:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448508.992021:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902791680 00000100:00100000:2.0:1788448508.992035:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902791680 00000100:00100000:2.0:1788448508.992116:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:2.0:1788448508.992129:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+43:10413:x1875323902791680:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1788448508.992256:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992279:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992295:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992331:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992339:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992358:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992366:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448508.992389:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992398:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992414:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448508.992418:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448508.992423:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.992430:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab342 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448508.993376:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+43:10413:x1875323902791680:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 1240us (1480us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448508.993388:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:2.0:1788448508.993442:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902791808 00000100:00100000:2.0:1788448508.993450:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902791808 00000100:00100000:2.0:1788448508.993498:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1788448508.993508:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+43:2353:x1875323902791808:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448508.993521:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448508.993545:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab334 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a97 expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448508.993563:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448508.993582:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448508.995879:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448508.995945:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902792064 00000100:00100000:3.0:1788448508.995956:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902792064 00000100:00100000:3.0:1788448508.996022:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:3.0:1788448508.996034:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+43:10413:x1875323902792064:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448508.996519:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+44:10413:x1875323902792064:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 483us (649us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788448508.996528:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1788448508.999485:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+43:2353:x1875323902791808:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 5958us (7510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448508.999533:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:0.0:1788448509.162986:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448509.163109:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902792320 00000100:00100000:2.0:1788448509.163123:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902792320 00000100:00100000:2.0:1788448509.163375:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:2.0:1788448509.163563:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+43:10431:x1875323902792320:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:2.0:1788448509.163604:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448509.163631:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab349 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510a9e expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.163772:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab350 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.163791:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.163805:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab350 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448509.163818:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788448509.164004:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab349 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a9e expref: 46 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.164028:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab350 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a9e expref: 45 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.164038:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:2.0:1788448509.164041:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788448509.164044:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247c00, rc 0) 00000100:00100000:2.0:1788448509.164273:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+45:10431:x1875323902792320:12345-192.168.204.37@tcp:101:cat.0 Request processed in 886us (1301us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1788448509.164283:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:1.0:1788448509.208636:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448509.208765:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902792448 00000100:00100000:2.0:1788448509.208781:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902792448 00000100:00100000:2.0:1788448509.208925:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:2.0:1788448509.208938:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+45:10432:x1875323902792448:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448509.208971:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448509.208997:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab35e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510aa5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209091:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209108:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209124:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448509.209183:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1788448509.209222:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448509.209257:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209291:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab35e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aa5 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209311:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aa5 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.209345:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:2.0:1788448509.209349:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448509.209364:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a809247200, rc 0) 00000100:00100000:2.0:1788448509.209575:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+46:10432:x1875323902792448:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 639us (955us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448509.209583:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:0.0:1788448509.213959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448509.214083:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902792832 00000100:00100000:3.0:1788448509.214096:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902792832 00000100:00100000:3.0:1788448509.215690:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1788448509.215720:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+46:10432:x1875323902792832:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448509.217070:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+47:10432:x1875323902792832:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1356us (3118us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788448509.217459:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:0.0:1788448509.220767:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448509.221419:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902792960 00000100:00100000:1.0:1788448509.221435:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902792960 00000100:00100000:1.0:1788448509.221533:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1788448509.221566:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:10432:x1875323902792960:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:1.0:1788448509.221588:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788448509.221631:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab2f5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a89 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448509.221660:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab350 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a9e expref: 46 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448509.221672:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab200 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a4a expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448509.221685:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a808bbff00) 00010000:00010000:1.0:1788448509.221704:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448509.221956:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+44:10432:x1875323902792960:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 393us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448509.221966:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1788448509.226834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448509.226925:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793088 00000100:00100000:3.0:1788448509.226940:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793088 00000100:00100000:3.0:1788448509.227073:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:3.0:1788448509.227087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+44:10432:x1875323902793088:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:3.0:1788448509.227292:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448509.227312:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448509.227329:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448509.227798:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448509.228069:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788448509.228171:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788448509.228778:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+44:10432:x1875323902793088:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 1684us (1951us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448509.228790:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:0.0:1788448509.262611:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448509.262774:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793216 00000100:00100000:2.0:1788448509.262787:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793216 00000100:00100000:2.0:1788448509.262867:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:2.0:1788448509.262881:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+44:10434:x1875323902793216:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448509.262910:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448509.262937:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab373 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510aac expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263031:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263049:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263064:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263084:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263092:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263125:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263475:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263485:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263494:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448509.263560:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788448509.263574:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448509.263600:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263614:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263623:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263630:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263638:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263645:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448509.263650:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263665:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263680:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:2.0:1788448509.263683:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448509.263688:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263695:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247c00/0xd0e9b344b90ab37a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263712:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263718:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263725:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263730:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448509.263733:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263738:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263745:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a804d04f00) 00010000:00010000:2.0:1788448509.263747:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448509.263750:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263767:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247800/0xd0e9b344b90ab381 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263808:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246c00/0xd0e9b344b90ab373 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263823:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 45 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448509.263831:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:2.0:1788448509.263834:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448509.263837:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:2.0:1788448509.263928:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+45:10434:x1875323902793216:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1050us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448509.263937:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00010000:00010000:2.0:1788448509.472581:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448509.984416:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448509.984429:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448509.984493:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788448509.984501:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448509.984645:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc64a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926936704:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448509.984867:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5be40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448509.993708:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448509.994310:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc64a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926936704:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448509.994381:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793344 00000100:00100000:0.0:1788448509.994389:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793344 00000100:00100000:0.0:1788448509.994452:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:0.0:1788448509.994463:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793344:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788448509.994559:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793344:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 Request processed in 98us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448509.994567:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:0.0:1788448510.003541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448510.003647:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793472 00000100:00100000:2.0:1788448510.003658:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793472 00000100:00080000:1.0:1788448510.004015:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448510.004022:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:2.0:1788448510.004043:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793472:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448510.004077:0:7154:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448510.004276:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793472:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 235us (743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.004285:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:1.0:1788448510.009526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448510.009861:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793600 00000100:00100000:2.0:1788448510.009872:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793600 00000100:00100000:2.0:1788448510.009961:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:2.0:1788448510.009972:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793600:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448510.010045:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010062:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010079:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010139:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010146:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010153:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010178:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010238:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010245:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448510.010283:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1788448510.010288:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448510.010300:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010310:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010316:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010335:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010341:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448510.010345:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010353:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010366:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:2.0:1788448510.010369:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448510.010373:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010390:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab38f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010742:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010750:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010756:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010761:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448510.010764:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010770:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010778:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff99a804d04f00) 00010000:00010000:2.0:1788448510.010781:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448510.010784:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010789:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178c00/0xd0e9b344b90ab396 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010804:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010809:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010820:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010824:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448510.010827:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010832:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010838:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:2.0:1788448510.010841:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448510.010843:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.010850:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab39d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448510.010935:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793600:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 963us (1428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.010944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:1.0:1788448510.013842:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.013911:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793856 00000100:00100000:0.0:1788448510.013921:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793856 00000100:00100000:0.0:1788448510.013975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:0.0:1788448510.013986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+45:10445:x1875323902793856:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.014006:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448510.014026:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3a4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ab3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014131:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014145:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014156:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448510.014166:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1788448510.014321:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014330:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014402:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014415:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.014419:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014426:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014439:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:0.0:1788448510.014441:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448510.014446:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014451:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014492:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3a4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ab3 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014508:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:0.0:1788448510.014511:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448510.014515:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3a4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ab3 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.014526:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec600, rc 0) 00000100:00100000:1.0:1788448510.014722:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902793856:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 688us (838us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1788448510.014729:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:3.0:1788448510.017498:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448510.017800:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902793984 00000100:00100000:2.0:1788448510.017811:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902793984 00000100:00100000:2.0:1788448510.017918:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:2.0:1788448510.017931:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902793984:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448510.017970:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448510.018068:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902793984:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 139us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.018087:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:1.0:1788448510.025451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.025500:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902794240 00000100:00100000:3.0:1788448510.025511:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902794240 00000100:00100000:3.0:1788448510.025565:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:3.0:1788448510.025577:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902794240:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448510.025601:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448510.025604:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788448510.025641:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809247200/0xd0e9b344b90ab365 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aa5 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.025659:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448510.025664:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448510.025677:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3b9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510aba expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448510.026317:0:7154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1788448510.026552:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab3c0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.026562:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.026570:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab3c0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.026609:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3b9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aba expref: 48 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.026624:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab3c0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aba expref: 47 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.026630:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674b00) 00010000:00010000:3.0:1788448510.026632:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448510.026634:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:3.0:1788448510.026688:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:10445:x1875323902794240:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1113us (1246us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788448510.026708:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:3.0:1788448510.030987:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.031246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902794496 00000100:00100000:0.0:1788448510.031257:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902794496 00000100:00100000:0.0:1788448510.031306:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:0.0:1788448510.031318:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+47:10445:x1875323902794496:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.031387:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448510.031413:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab3c0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aba expref: 47 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031431:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674b00) 00010000:00010000:0.0:1788448510.031443:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448510.031464:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031478:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031488:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031505:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031512:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031520:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031882:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031891:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031897:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031910:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.031915:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031923:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031934:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448510.031937:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448510.031941:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031947:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab3ce lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031961:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031967:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031974:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031979:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.031982:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.031989:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.032011:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x2beadd7 (ffff99a80bd82900) 00010000:00010000:0.0:1788448510.032013:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448510.032017:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.032023:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3d5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x2beadd7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.032177:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902794496:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 860us (1209us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448510.032231:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:1.0:1788448510.035839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.035895:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902794624 00000100:00100000:3.0:1788448510.035917:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902794624 00000100:00100000:3.0:1788448510.035975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:3.0:1788448510.035986:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+46:10445:x1875323902794624:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448510.036008:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448510.036033:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab3dc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ac1 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.036066:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.037303:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.037321:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.037463:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab3dc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.037481:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 47 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.037489:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.037492:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448510.037496:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:0.0:1788448510.037575:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+47:10445:x1875323902794624:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1591us (1743us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448510.037583:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:2.0:1788448510.040538:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.040644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902794880 00000100:00100000:1.0:1788448510.040654:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902794880 00000100:00100000:1.0:1788448510.040724:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:1.0:1788448510.040735:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+47:10445:x1875323902794880:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448510.040828:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.040844:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.040855:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448510.041137:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1788448510.041146:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 370647959558ns, next at 371647957874ns, rc = 0 00000004:00010000:1.0:1788448510.041974:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009707b776 reply state 00000000beabc21c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.041986:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448510.042101:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+49:10445:x1875323902794880:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1365us (1568us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1788448510.042109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00010000:00010000:0.0:1788448510.047654:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047672:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047692:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047697:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.047702:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047710:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047728:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.047731:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448510.047737:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.047743:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab3ea lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448510.051156:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.051331:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795008 00000100:00100000:3.0:1788448510.051341:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795008 00000100:00100000:3.0:1788448510.051393:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:3.0:1788448510.051404:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+48:10445:x1875323902795008:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448510.051429:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448510.051450:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ac8 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.051527:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 49 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.051558:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 49 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.051580:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:3.0:1788448510.051584:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448510.051587:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:3.0:1788448510.051645:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+49:10445:x1875323902795008:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 243us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.051653:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1788448510.059707:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.060146:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795136 00000100:00100000:3.0:1788448510.060157:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795136 00000100:00100000:2.0:1788448510.060356:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1788448510.060364:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875323902795136:12345-192.168.204.37@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788448510.060395:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp t0 exp 0000000000000000 cur 370 last 0 00000020:00000080:2.0:1788448510.060428:0:6680:0:(genops.c:1385:class_connect()) connect: client af250c24-64ec-487b-a1ec-11a62017775a, cookie 0xd0e9b344b90ab3f8 00002000:00100000:2.0:1788448510.060440:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli af250c24-64ec-487b-a1ec-11a62017775a/ffff99a82949b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448510.060451:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448510.060681:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448510.060712:0:6680:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448510.060839:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2351:x1875323902795136:12345-192.168.204.37@tcp:8:lhsmtool_posix.0 Request processed in 473us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.060847:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:1.0:1788448510.064178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.064312:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795264 00000100:00100000:3.0:1788448510.064322:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795264 00000100:00100000:3.0:1788448510.064507:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1788448510.064524:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:0:x1875323902795264:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788448510.064869:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448510.151372:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:0:x1875323902795264:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 86841us (87194us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1788448510.151384:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000001:00100000:3.0:1788448510.151417:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000001:00080000:3.0:1788448510.151428:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:2.0:1788448510.167628:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.167753:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795520 00000100:00100000:3.0:1788448510.167764:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795520 00000100:00100000:3.0:1788448510.167826:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:3.0:1788448510.167836:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+49:10445:x1875323902795520:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788448510.168060:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+50:10445:x1875323902795520:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 225us (442us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1788448510.168090:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:2.0:1788448510.172286:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.173665:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795776 00000100:00100000:0.0:1788448510.173678:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795776 00000100:00100000:0.0:1788448510.173739:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:0.0:1788448510.173750:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+50:10445:x1875323902795776:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448510.173847:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+50:10445:x1875323902795776:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 99us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448510.173855:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:3.0:1788448510.178640:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.178746:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902795904 00000100:00100000:0.0:1788448510.178757:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902795904 00000100:00100000:0.0:1788448510.178809:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:0.0:1788448510.178820:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+50:10445:x1875323902795904:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.178848:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448510.178869:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510acf expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.178942:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.178956:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.178966:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448510.179003:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448510.179021:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.179047:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab3ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510acf expref: 52 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.179063:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510acf expref: 51 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.179072:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.179075:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788448510.179079:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec600, rc 0) 00000100:00100000:0.0:1788448510.179137:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:10445:x1875323902795904:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 318us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448510.179144:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:2.0:1788448510.181848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.182000:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796032 00000100:00100000:3.0:1788448510.182009:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796032 00000100:00100000:3.0:1788448510.182151:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1788448510.182163:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902796032:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448510.182180:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448510.182441:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ad6 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448510.182470:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998efc, blocks: 0x1 00010000:00010000:3.0:1788448510.182489:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1788448510.182494:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448510.182504:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.182539:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.182554:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628c00, rc 0) 00000100:00100000:3.0:1788448510.182646:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902796032:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 485us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.182653:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:2.0:1788448510.197035:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.197113:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796288 00000100:00100000:1.0:1788448510.197123:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796288 00000100:00100000:1.0:1788448510.197176:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:1.0:1788448510.197208:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+51:10445:x1875323902796288:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448510.197320:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+51:10445:x1875323902796288:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 135us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.197350:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1788448510.202706:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.202819:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796416 00000100:00100000:1.0:1788448510.202830:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796416 00000100:00100000:1.0:1788448510.202895:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1788448510.202906:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:10445:x1875323902796416:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448510.202927:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448510.202951:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510add expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.202982:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.202992:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448510.202997:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448510.203002:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.203035:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.203051:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 7 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.203066:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875323926936832:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448510.203149:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547b240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448510.214100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.214587:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796544 00000100:00100000:0.0:1788448510.214598:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796544 00010000:00010000:0.0:1788448510.214640:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 8 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.214676:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:0.0:1788448510.214686:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804616850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902796544:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448510.214700:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448510.214723:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 8 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.214737:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 8 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.214762:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448510.214768:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448510.214775:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.214786:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.214825:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.214839:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875323926936960:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448510.214922:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2ab40 going to sleep for 11 seconds 00010000:00010000:1.0:1788448510.216664:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce004cc0/0xd0e9b344b90ab40d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ad6 expref: 8 pid: 6680 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.216684:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875323926936832:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448510.216712:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.216726:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d200, rc 0) 00000100:00100000:1.0:1788448510.216768:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:10445:x1875323902796416:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 13864us (14072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.216776:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1788448510.233116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.233155:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796672 00000100:00100000:1.0:1788448510.233163:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796672 00002000:00100000:1.0:1788448510.233245:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99a7056c4380 x1875323902796672/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:746/0 lens 504/0 e 0 to 0 dl 1788448521 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448510.233255:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a7056c4380 with x1875323902796672 ext(0->8) 00002000:00010000:1.0:1788448510.233261:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a7056c4380 00000100:00100000:1.0:1788448510.233288:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1788448510.233299:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902796672:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788448510.233978:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902796672:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 679us (868us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788448510.233985:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00002000:00100000:1.0:1788448510.233992:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff99a7056c4380 x1875323902796672/t4294967302(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:746/0 lens 504/448 e 0 to 0 dl 1788448521 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448510.234013:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a7056c4380 with x1875323902796672 ext(0->8) 00002000:00010000:1.0:1788448510.234016:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a7056c4380 00000100:00100000:3.0:1788448510.234547:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5824:1875323926936960:192.168.204.37@tcp:105: 00010000:00010000:3.0:1788448510.234577:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448510.234619:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804616850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902796544:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 19934us (20527us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.234627:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1788448510.258493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.260021:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796800 00000100:00100000:0.0:1788448510.260035:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796800 00000100:00100000:0.0:1788448510.260145:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:0.0:1788448510.260156:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:10445:x1875323902796800:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000040:00080000:0.0:1788448510.262485:0:11997:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448510.262496:0:11997:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448510.262551:0:11997:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788448510.262557:0:11997:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448510.357131:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:10445:x1875323902796800:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 96967us (98638us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.357145:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000001:00080000:2.0:1788448510.357180:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:2.0:1788448510.357228:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967353 is committed 00000004:00080000:2.0:1788448510.357245:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000001:00080000:2.0:1788448510.357296:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1788448510.357309:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:2.0:1788448510.357333:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a807d2a780 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:2.0:1788448510.357337:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a807842500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a839ac7780 00000020:00080000:2.0:1788448510.357340:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a807842200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a835a8d800 00000020:00080000:2.0:1788448510.357502:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788448510.357614:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788448510.357625:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448510.357642:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926937088:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788448510.357703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448510.357761:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448510.357770:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926937216:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788448510.357797:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448510.357829:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926937088 00000100:00100000:2.0:1788448510.357836:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926937088 00000100:00100000:2.0:1788448510.357882:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926937216 00000100:00100000:2.0:1788448510.357885:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926937216 00000100:00100000:2.0:1788448510.357903:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448510.357911:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926937088:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1788448510.358032:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788448510.358036:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788448509 00002000:00010000:2.0:1788448510.358038:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788448510.358041:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788448508 -> 1788448509 00002000:00010000:2.0:1788448510.358043:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788448510.358076:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926937088:12345-0@lo:2:osp-syn-0-0.0 Request processed in 166us (373us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788448510.358093:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448510.358108:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448510.358114:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926937216:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788448510.358129:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1788448510.358155:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a998ef9, atime: 0x6a998ef9, ctime: 0x6a998ef9, blocks: 0x1 00010000:00010000:2.0:1788448510.358162:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.358177:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=370s v=(0 0) 00010000:00010000:2.0:1788448510.358182:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448510.358227:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.358243:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.358254:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.358262:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.358279:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788448510.358808:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3310:x1875323926937216:12345-0@lo:6:osp-syn-1-0.0 Request processed in 691us (1008us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788448510.358816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:2.0:1788448510.358875:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a83fc64000/2, rc 0, transno 4294967303 00000100:00100000:2.0:1788448510.358882:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926937088:0@lo:2:osp-syn-0-0.0 00000004:00080000:2.0:1788448510.359004:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a83fc67800/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788448510.359010:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926937216:0@lo:6:osp-syn-1-0.0 00000100:00080000:3.0:1788448510.360039:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448510.360046:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448510.360121:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448510.360131:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.360144:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448510.360149:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.360161:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.360205:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.360224:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e2565e2/0xd0e9b344b90ab41b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.360250:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448510.360252:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448510.360254:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448510.363888:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.364309:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902796928 00000100:00100000:0.0:1788448510.364318:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902796928 00000100:00100000:0.0:1788448510.364376:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:0.0:1788448510.364385:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902796928:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788448510.430698:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902796928:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 66303us (66808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448510.430712:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000001:00080000:3.0:1788448510.434144:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1788448510.434168:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:1.0:1788448510.450770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.451734:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797184 00000100:00100000:0.0:1788448510.451745:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797184 00000100:00100000:0.0:1788448510.451802:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:0.0:1788448510.451812:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+13:10445:x1875323902797184:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.451867:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448510.451897:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab406 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510acf expref: 13 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.451918:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.451923:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448510.451963:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.451976:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.451986:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448510.452257:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cc8a7289 reply state 0000000038833fc8 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.452266:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448510.452427:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:10445:x1875323902797184:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 615us (1664us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788448510.452435:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00010000:00010000:1.0:1788448510.459938:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.459974:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.459981:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.459987:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448510.459992:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.460000:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.460017:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:1.0:1788448510.460020:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448510.460026:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.460032:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab422 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.468911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.468948:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797312 00000100:00100000:1.0:1788448510.468958:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797312 00000100:00100000:1.0:1788448510.469014:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:1.0:1788448510.469024:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902797312:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1788448510.469320:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1788448510.469324:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788448509 -> 1788448507 00002000:00010000:1.0:1788448510.469326:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788448505 00002000:00010000:1.0:1788448510.469336:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788448509 -> 1788448507 00002000:00010000:1.0:1788448510.469338:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1788448510.469392:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902797312:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 369us (489us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788448510.469399:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1788448510.477420:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448510.477495:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797568 00000100:00100000:2.0:1788448510.477516:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797568 00000100:00100000:2.0:1788448510.477589:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:2.0:1788448510.477603:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+13:10445:x1875323902797568:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788448510.477673:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.477693:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.477702:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.477736:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.477750:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 13 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448510.477764:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc66680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926937344:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448510.477856:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448510.481724:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.481920:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc66680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926937344:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448510.481949:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448510.482146:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797696 00000100:00100000:3.0:1788448510.482154:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797696 00010000:00010000:3.0:1788448510.482224:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 14 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448510.482267:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:3.0:1788448510.482289:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+14:2352:x1875323902797696:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448510.482320:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448510.482329:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 14 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482362:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 14 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482629:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab3e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac1 expref: 14 pid: 5837 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482671:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:3.0:1788448510.482675:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482782:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482802:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.482833:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448510.482946:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:2352:x1875323902797696:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 668us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.482969:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00010000:00010000:0.0:1788448510.483103:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483113:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483143:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483149:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483163:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483168:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.483172:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483180:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483256:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.483259:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788448510.483263:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.483269:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179e00/0xd0e9b344b90ab429 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.483314:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+12:10445:x1875323902797568:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 5715us (5906us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788448510.483334:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:1.0:1788448510.491759:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.491837:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797824 00000100:00100000:0.0:1788448510.491849:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797824 00000100:00100000:0.0:1788448510.491911:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:0.0:1788448510.491922:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902797824:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.491970:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.491994:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.492016:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788448510.492021:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448510.492025:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.492063:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.492091:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 7 pid: 6682 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.492106:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926937472:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448510.492236:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448510.494676:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926937472:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448510.494705:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.496365:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448510.496982:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.497743:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902797952 00000100:00100000:3.0:1788448510.497753:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902797952 00010000:00010000:3.0:1788448510.497800:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448510.497848:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:3.0:1788448510.497859:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902797952:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448510.497873:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448510.497899:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.497913:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.497937:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ab414 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510add expref: 8 pid: 6682 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.497972:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448510.497976:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448510.497983:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.497992:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.498030:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448510.498097:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902797952:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 239us (1122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.498105:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00010000:00010000:1.0:1788448510.498438:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498449:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498480:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498488:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498495:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498510:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448510.498515:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498523:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498548:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.498554:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ab430 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.498617:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902797824:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 6697us (6869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.498625:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:1.0:1788448510.504733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448510.504813:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798208 00000100:00100000:0.0:1788448510.504823:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798208 00000100:00100000:0.0:1788448510.504882:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:0.0:1788448510.504892:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+12:10445:x1875323902798208:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448510.504974:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505009:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505021:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505292:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505304:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 13 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505313:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505350:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 13 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.505364:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 13 pid: 7154 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.505378:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926937600:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448510.505474:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448510.509491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448510.509820:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798336 00000100:00100000:1.0:1788448510.509830:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798336 00010000:00010000:1.0:1788448510.509871:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 14 pid: 7154 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.509915:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448510.509925:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+14:2353:x1875323902798336:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448510.509939:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448510.509945:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 14 pid: 7154 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.509957:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 14 pid: 7154 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.509979:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:1.0:1788448510.509993:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.510004:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.510011:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.510032:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448510.510095:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+14:2353:x1875323902798336:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 169us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.510102:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00010000:00010000:0.0:1788448510.510691:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab3f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ac8 expref: 13 pid: 7154 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.510709:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926937600:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448510.510730:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.510747:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.510753:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448510.510939:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:0.0:1788448510.511094:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:0.0:1788448510.511142:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:0.0:1788448510.511296:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926937728:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448510.511348:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448510.511490:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448510.513294:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926937728 00000100:00100000:3.0:1788448510.513307:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926937728 00000100:00100000:2.0:1788448510.513682:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448510.513694:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926937728:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788448510.513835:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926937728:12345-0@lo:1000:mdt00_002.0 Request processed in 144us (2487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448510.513843:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448510.513915:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1788448510.513921:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a83fc64000, transno 4294967303 00000100:00100000:0.0:1788448510.513946:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926937728:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788448510.514513:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1788448510.514609:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926937856:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448510.514649:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448510.515272:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a840 going to sleep for 11 seconds 00000100:00100000:1.0:1788448510.517711:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926937856 00000100:00100000:1.0:1788448510.517727:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926937856 00000100:00100000:1.0:1788448510.517795:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448510.517806:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926937856:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448510.518491:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5839:x1875323926937856:12345-0@lo:1000:mdt00_002.0 Request processed in 684us (3838us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788448510.518501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448510.518601:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926937856:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788448510.518648:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518662:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518670:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518693:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.518698:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518706:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518721:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674600) 00010000:00010000:0.0:1788448510.518724:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448510.518729:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518736:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab43e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518777:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518783:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518789:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518794:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448510.518797:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518803:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518822:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:0.0:1788448510.518824:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448510.518827:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518833:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab36c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518854:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518869:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518879:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518912:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.518926:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 16 pid: 5839 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448510.518939:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926937984:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448510.519062:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448510.522681:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926937984:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448510.522716:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448510.524037:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.524652:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798464 00000100:00100000:3.0:1788448510.524663:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798464 00010000:00010000:3.0:1788448510.524706:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 17 pid: 5839 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448510.524749:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:3.0:1788448510.524760:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+17:2353:x1875323902798464:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448510.524777:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448510.524784:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 17 pid: 5839 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524798:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 17 pid: 5839 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524835:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab388 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aac expref: 17 pid: 5839 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524851:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448510.524856:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524865:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524873:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.524911:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448510.524969:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+16:2353:x1875323902798464:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 211us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.524976:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00010000:00010000:1.0:1788448510.526023:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526034:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526048:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526054:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526087:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526093:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448510.526098:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526106:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526119:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:1.0:1788448510.526123:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448510.526127:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526132:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab445 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526146:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526151:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526157:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526162:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448510.526164:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526180:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526240:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674c00) 00010000:00010000:1.0:1788448510.526243:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448510.526246:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448510.526252:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab437 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448510.526508:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+15:10445:x1875323902798208:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 21614us (21782us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1788448510.526519:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000020:00080000:1.0:1788448510.526526:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788448510.526865:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448510.526869:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448510.526894:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788448510.526900:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448510.530572:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448510.530658:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798720 00000100:00100000:3.0:1788448510.530669:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798720 00000100:00100000:3.0:1788448510.530727:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:3.0:1788448510.530738:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+15:10445:x1875323902798720:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788448510.531499:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788448510.531617:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1788448510.531665:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531681:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531704:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531713:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531718:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531724:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448510.531866:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788448510.531958:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+17:10445:x1875323902798720:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 1220us (1395us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1788448510.531966:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000020:00080000:3.0:1788448510.531972:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448510.534519:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448510.534533:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.534543:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448510.534547:0:11159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.534556:0:11159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.534634:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff99a829674b00) 00010000:00010000:2.0:1788448510.534638:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788448510.534643:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448510.534649:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab44c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448510.534786:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448510.534790:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448510.534792:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448510.563530:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926938112:0@lo:400:kworker.0 00000100:00100000:2.0:1788448510.563602:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448510.563760:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926938496:0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.563796:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448510.563853:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938496 00000100:00100000:1.0:1788448510.563860:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938496 00000100:00100000:1.0:1788448510.563915:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788448510.563925:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926938496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.563973:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926938496:12345-0@lo:400:kworker.0 Request processed in 49us (175us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.563980:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:1.0:1788448510.564001:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448510.564030:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926938496:0@lo:400:kworker.0 00000100:00100000:3.0:1788448510.564817:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938112 00000100:00100000:3.0:1788448510.564825:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938112 00000100:00100000:3.0:1788448510.564872:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788448510.564882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926938112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.568713:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448510.568815:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926938624:0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.568885:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448510.570274:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3310:x1875323926938112:12345-0@lo:400:kworker.0 Request processed in 5387us (6664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448510.570287:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788448510.570360:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926938368:0@lo:400:kworker.0 00000100:00100000:3.0:1788448510.570401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448510.570430:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448510.570437:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926938240:0@lo:400:kworker.0 00000100:00100000:3.0:1788448510.570477:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448510.572807:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938368 00000100:00100000:1.0:1788448510.572821:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938368 00000100:00100000:1.0:1788448510.572906:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938240 00000100:00100000:1.0:1788448510.572910:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938240 00000100:00100000:1.0:1788448510.572934:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448510.572944:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926938368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.573031:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1875323926938368:12345-0@lo:400:kworker.0 Request processed in 88us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.573039:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788448510.573055:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788448510.573061:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926938240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.573103:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926938240:12345-0@lo:400:kworker.0 Request processed in 41us (2625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448510.573109:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788448510.573152:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926938240:0@lo:400:kworker.0 00000100:00100000:1.0:1788448510.573163:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3312:1875323926938368:0@lo:400:kworker.0 00000100:00080000:3.0:1788448510.573343:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448510.574500:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938624 00000100:00100000:0.0:1788448510.574522:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938624 00000100:00100000:0.0:1788448510.574574:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788448510.574598:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926938624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448510.574666:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926938624:12345-0@lo:400:kworker.0 Request processed in 84us (5781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448510.574673:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448510.574860:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926938624:0@lo:400:kworker.0 00000100:00100000:2.0:1788448510.576227:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926938112:0@lo:400:kworker.0 00000100:00100000:1.0:1788448511.073033:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448511.083050:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926938752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448511.083247:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448511.086536:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926938752 00000100:00100000:2.0:1788448511.086561:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926938752 00000100:00100000:2.0:1788448511.086797:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788448511.086823:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926938752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448511.086889:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448511.087073:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926938752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 265us (3842us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448511.087081:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448511.087369:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926938752:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788448511.526627:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788448512.203032:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:0.0:1788448512.203052:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000040:00080000:0.0:1788448512.283524:0:12051:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448512.283532:0:12051:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448512.283565:0:12051:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788448512.283570:0:12051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448512.437505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.437560:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.437891:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798848 00000100:00100000:3.0:1788448512.437902:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798848 00000100:00100000:3.0:1788448512.437955:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 288 00000100:00100000:3.0:1788448512.437967:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902798848:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448512.438043:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902798848:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 78us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448512.438051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 288 00000100:00100000:2.0:1788448512.440043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.440113:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.441276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.441302:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902799104 00000100:00100000:2.0:1788448512.441311:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902799104 00000100:00100000:2.0:1788448512.441374:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902799232 00000100:00100000:2.0:1788448512.441377:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902799232 00000100:00100000:2.0:1788448512.441398:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:2.0:1788448512.441407:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902799104:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448512.441466:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902799104:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 61us (3906us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448512.441486:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:2.0:1788448512.441504:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:2.0:1788448512.441510:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902799232:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448512.441536:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902799232:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448512.441554:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1788448512.442159:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902798976 00000100:00100000:0.0:1788448512.442160:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902799360 00000100:00100000:1.0:1788448512.442174:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902798976 00000100:00100000:0.0:1788448512.442315:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902799360 00000100:00100000:0.0:1788448512.442413:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:0.0:1788448512.442422:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902799360:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448512.442461:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902799360:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 40us (2425us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448512.442467:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:1.0:1788448512.444194:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:1.0:1788448512.444208:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+17:2352:x1875323902798976:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448512.444271:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+17:2352:x1875323902798976:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 67us (4158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448512.444287:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00080000:3.0:1788448512.444862:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448512.444869:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448512.444872:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448512.456980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448512.457093:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902799616 00000100:00100000:1.0:1788448512.457104:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902799616 00000100:00100000:1.0:1788448512.457224:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:1.0:1788448512.457236:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+17:10464:x1875323902799616:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448512.457257:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448512.457278:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab453 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ae4 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.457382:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab45a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.457397:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab45a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.457411:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab45a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448512.457423:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:1.0:1788448512.458284:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab453 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ae4 expref: 20 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.458304:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab45a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ae4 expref: 19 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.458312:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448512.458315:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448512.458319:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9ce00, rc 0) 00000100:00100000:1.0:1788448512.458428:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:10464:x1875323902799616:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1194us (1454us total) trans 4294967363 rc 0/0 00000100:00100000:1.0:1788448512.458437:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1788448512.464539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448512.464773:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902799744 00000100:00100000:0.0:1788448512.464785:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902799744 00000100:00100000:0.0:1788448512.464859:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:0.0:1788448512.464883:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:10464:x1875323902799744:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1788448512.464967:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.464987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465000:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465016:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465023:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465030:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465330:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465339:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465347:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448512.465388:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465401:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465414:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465422:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465427:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448512.465432:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465439:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465452:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448512.465455:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448512.465459:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465465:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab468 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465477:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465494:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465499:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465503:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448512.465513:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465519:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465526:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a80bd82700) 00010000:00010000:0.0:1788448512.465528:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448512.465531:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465536:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab46f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465551:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465556:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.465562:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.466024:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448512.466028:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.466035:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.466044:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a80bd82f00) 00010000:00010000:0.0:1788448512.466047:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448512.466058:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.466064:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab476 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448512.466150:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:10464:x1875323902799744:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 1268us (1618us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448512.466158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00010000:00010000:2.0:1788448512.544585:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448512.556479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.557081:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902800000 00000100:00100000:3.0:1788448512.557092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902800000 00000100:00100000:3.0:1788448512.557159:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:3.0:1788448512.557179:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+19:10467:x1875323902800000:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448512.557236:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448512.557257:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab47d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510aeb expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.558091:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.558112:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.558144:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.558161:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.558182:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.559096:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.559890:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.559903:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.559911:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448512.559924:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788448512.560021:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560029:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560036:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560042:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448512.560054:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560062:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560073:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448512.560076:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448512.560080:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560086:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab484 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560098:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560103:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560108:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560112:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448512.560114:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560120:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560127:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674e00) 00010000:00010000:3.0:1788448512.560129:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448512.560137:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560142:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab48b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560262:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab47d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 22 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560276:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.560283:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448512.560285:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448512.560287:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:3.0:1788448512.560820:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+21:10467:x1875323902800000:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 3641us (4347us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788448512.560830:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:2.0:1788448512.577315:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448512.577853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902800128 00000100:00100000:1.0:1788448512.577863:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902800128 00000100:00100000:1.0:1788448512.577966:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:1.0:1788448512.577977:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:10467:x1875323902800128:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448512.578046:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578063:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578075:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578102:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578109:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578115:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578121:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448512.578126:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578134:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578175:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448512.578179:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448512.578204:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.578211:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448512.578293:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:10467:x1875323902800128:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 319us (989us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448512.578300:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:2.0:1788448512.589012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448512.589120:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902800384 00000100:00100000:1.0:1788448512.589131:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902800384 00000100:00100000:1.0:1788448512.589233:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1788448512.589243:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+21:10467:x1875323902800384:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448512.590978:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace1450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:10467:x1875323902800384:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1729us (1968us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1788448512.590989:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:2.0:1788448512.654585:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448512.654951:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902800640 00000100:00100000:0.0:1788448512.654962:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902800640 00000100:00100000:0.0:1788448512.655026:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:0.0:1788448512.655036:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+22:9985:x1875323902800640:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448512.655062:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448512.655082:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab4a7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510af2 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.655426:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.655442:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.655451:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.655486:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.655517:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 23 pid: 5837 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448512.655531:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926938880:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448512.657245:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448512.665030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.665251:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902800768 00000100:00100000:2.0:1788448512.665261:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902800768 00010000:00010000:2.0:1788448512.665303:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 24 pid: 5837 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448512.665340:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:2.0:1788448512.665350:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+24:2353:x1875323902800768:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448512.665364:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448512.665372:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 24 pid: 5837 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.665404:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 24 pid: 5837 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.665426:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:2.0:1788448512.665431:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.665441:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.665449:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.665468:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448512.665526:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+24:2353:x1875323902800768:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 177us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448512.665534:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00010000:00010000:1.0:1788448512.671137:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510aeb expref: 23 pid: 5837 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448512.671160:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926938880:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448512.671233:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.671244:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.671249:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448512.671303:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1788448512.673113:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab4a7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 24 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.673137:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 23 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.673145:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448512.673148:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448512.673152:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:1.0:1788448512.673322:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+23:9985:x1875323902800640:12345-192.168.204.37@tcp:101:bash.0 Request processed in 18286us (18747us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1788448512.673342:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:0.0:1788448512.683569:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.684585:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801024 00000100:00100000:2.0:1788448512.684597:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801024 00000100:00100000:2.0:1788448512.684669:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:2.0:1788448512.684680:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:9985:x1875323902801024:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:2.0:1788448512.685295:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.685312:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.685323:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448512.685510:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1788448512.685603:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000019fd5bdd reply state 000000003dd5c53e transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448512.685612:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1788448512.685913:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1788448512.686021:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+27:9985:x1875323902801024:12345-192.168.204.37@tcp:36:bash.0 Request processed in 1340us (2458us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1788448512.686029:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00000020:00080000:2.0:1788448512.686034:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:0.0:1788448512.691178:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691241:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691249:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691256:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448512.691261:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691285:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691303:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:0.0:1788448512.691306:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448512.691311:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448512.691317:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab4bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448512.691793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.698298:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801152 00000100:00100000:3.0:1788448512.698317:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801152 00000100:00100000:3.0:1788448512.698407:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:3.0:1788448512.698420:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+26:9985:x1875323902801152:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448512.698448:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448512.698472:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab4c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510af9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.698546:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af9 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.698581:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab4c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af9 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.698604:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448512.698607:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448512.698611:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:3.0:1788448512.698684:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+27:9985:x1875323902801152:12345-192.168.204.37@tcp:101:bash.0 Request processed in 267us (6894us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448512.698692:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:0.0:1788448512.703594:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.703703:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801280 00000100:00100000:2.0:1788448512.703711:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801280 00000100:00100000:2.0:1788448512.703772:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1788448512.703783:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a809241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:9985:x1875323902801280:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448512.703801:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448512.703825:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b00 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448512.703853:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a998efb, atime: 0x6a998ef9, ctime: 0x6a998efb, blocks: 0xb 00010000:00010000:2.0:1788448512.703874:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:2.0:1788448512.703880:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448512.703889:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.703909:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.703942:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178c00, rc 0) 00000100:00100000:2.0:1788448512.704260:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a809241050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:9985:x1875323902801280:12345-192.168.204.37@tcp:101:bash.0 Request processed in 478us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448512.704268:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1788448512.722119:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.722272:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801408 00000100:00100000:3.0:1788448512.722281:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801408 00002000:00010000:3.0:1788448512.722320:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788448512.722324:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc67480 with x1875323902801408 ext(0->18446744073709551615) 00002000:00010000:3.0:1788448512.722335:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83fc67480. 00000100:00100000:3.0:1788448512.722365:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448512.722373:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902801408:12345-192.168.204.37@tcp:10:bash.0 00002000:00010000:3.0:1788448512.722652:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788448512.722655:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1788448507 -> 1788448511 00002000:00010000:3.0:1788448512.722658:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1788448505 -> 1788448505 00002000:00010000:3.0:1788448512.722660:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1788448507 -> 1788448511 00002000:00010000:3.0:1788448512.722662:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1788448512.722725:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902801408:12345-192.168.204.37@tcp:10:bash.0 Request processed in 351us (615us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788448512.722733:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00002000:00010000:3.0:1788448512.722737:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:3.0:1788448512.722752:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc67480 with x1875323902801408 ext(0->18446744073709551615) 00002000:00010000:3.0:1788448512.722756:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83fc67480. 00000100:00100000:0.0:1788448512.849474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448512.849613:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801536 00000100:00100000:1.0:1788448512.849622:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801536 00000100:00100000:1.0:1788448512.849687:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:1.0:1788448512.849696:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+27:10481:x1875323902801536:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1788448512.849778:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.849794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.849810:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.849825:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.849851:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.849858:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850125:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850141:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850148:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448512.850253:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850271:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850278:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850285:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850290:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448512.850299:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850308:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850331:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448512.850334:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448512.850339:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850345:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab4d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850358:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850364:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850371:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850376:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448512.850379:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850385:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850391:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf400) 00010000:00010000:1.0:1788448512.850393:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448512.850396:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850402:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab4d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850424:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850430:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850436:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850441:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448512.850444:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850450:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850457:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448512.850459:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448512.850462:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448512.850468:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab4df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448512.850533:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+27:10481:x1875323902801536:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 837us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448512.850540:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:0.0:1788448512.929837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.929986:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801792 00000100:00100000:3.0:1788448512.929996:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801792 00000100:00100000:3.0:1788448512.930065:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:3.0:1788448512.930076:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+27:10484:x1875323902801792:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448512.930098:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448512.930120:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab4e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b07 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930241:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930257:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930268:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930397:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930405:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930413:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930711:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab4fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930907:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.930915:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab4fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448512.930925:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788448512.931426:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931438:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931445:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931452:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448512.931456:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931463:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931475:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448512.931478:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448512.931482:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931489:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab4ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931503:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931516:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931522:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931527:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448512.931531:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931537:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931545:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674e00) 00010000:00010000:3.0:1788448512.931549:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448512.931551:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.931985:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab4f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.932115:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab4e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b07 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.932130:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab4fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b07 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.932137:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448512.932139:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1788448512.932148:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:3.0:1788448512.932321:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+29:10484:x1875323902801792:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2246us (2494us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1788448512.932330:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:0.0:1788448512.934960:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.935265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902801920 00000100:00100000:2.0:1788448512.935285:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902801920 00000100:00100000:2.0:1788448512.935344:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:2.0:1788448512.935355:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+29:10484:x1875323902801920:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1788448512.935420:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.935436:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.935445:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.935477:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.935501:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 29 pid: 7154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448512.935516:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926939008:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448512.935615:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448512.937775:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448512.940495:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc64380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926939008:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448512.940527:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448512.944062:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902802176 00000100:00100000:3.0:1788448512.944079:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902802176 00000100:00100000:3.0:1788448512.944155:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1788448512.944177:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+30:5590:x1875323902802176:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788448512.945449:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+31:5590:x1875323902802176:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 1267us (7675us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1788448512.945460:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:2.0:1788448512.967658:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.968140:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902802304 00000100:00100000:3.0:1788448512.968167:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902802304 00010000:00010000:3.0:1788448512.968243:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 31 pid: 7154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448512.968288:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1788448512.968300:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+31:2352:x1875323902802304:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448512.968314:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448512.968320:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 31 pid: 7154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968334:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 31 pid: 7154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968358:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab4ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af2 expref: 31 pid: 7154 timeout: 473 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968396:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448512.968402:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968413:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968420:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448512.968507:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448512.968577:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+30:2352:x1875323902802304:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 278us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448512.968585:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00010000:00010000:2.0:1788448512.977285:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977304:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977344:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977352:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977360:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977366:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448512.977370:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977377:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977395:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:2.0:1788448512.977398:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448512.977402:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448512.977431:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448512.977529:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+29:10484:x1875323902801920:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 42172us (42573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448512.977540:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:2.0:1788448512.980806:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448512.980927:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902802560 00000100:00100000:3.0:1788448512.980937:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902802560 00000100:00100000:3.0:1788448512.980995:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1788448512.981005:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+29:10484:x1875323902802560:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448512.981279:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+30:10484:x1875323902802560:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 274us (482us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1788448512.981287:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:0.0:1788448513.135111:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448513.135470:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902802816 00000100:00100000:1.0:1788448513.135490:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902802816 00000100:00100000:1.0:1788448513.135568:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:1.0:1788448513.135609:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+30:10495:x1875323902802816:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1788448513.135637:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448513.135657:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab510 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b0e expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135756:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135790:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135804:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135820:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135827:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.135834:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.136878:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab525 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.136957:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.136970:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab525 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448513.136992:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1788448513.137090:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137100:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137107:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137114:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448513.137117:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137124:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137137:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448513.137140:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448513.137144:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137150:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab517 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137175:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137181:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137292:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137297:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448513.137301:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137308:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137317:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf400) 00010000:00010000:1.0:1788448513.137319:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448513.137322:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137329:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab51e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137373:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab510 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b0e expref: 33 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137387:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab525 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b0e expref: 32 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.137394:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448513.137396:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448513.137398:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d000, rc 0) 00000100:00100000:1.0:1788448513.137483:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+32:10495:x1875323902802816:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1878us (2377us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1788448513.137501:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:1.0:1788448513.146343:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.146500:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803072 00000100:00100000:3.0:1788448513.146510:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803072 00000100:00100000:3.0:1788448513.146581:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:3.0:1788448513.146590:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+32:10495:x1875323902803072:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:3.0:1788448513.146828:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+33:10495:x1875323902803072:12345-192.168.204.37@tcp:35:cat.0 Request processed in 238us (494us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1788448513.146850:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:2.0:1788448513.177884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.177994:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803328 00000100:00100000:3.0:1788448513.178009:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803328 00000100:00100000:3.0:1788448513.178091:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1788448513.178103:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+33:10496:x1875323902803328:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:3.0:1788448513.178510:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788448513.178539:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab525 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b0e expref: 33 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178578:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab4fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b07 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178595:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab4c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510af9 expref: 31 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178605:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448513.178616:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448513.178639:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178652:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178661:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178675:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178701:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178708:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178948:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178957:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.178964:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448513.179498:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:3.0:1788448513.179507:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373786321169ns, next at 374786318984ns, rc = 0 00010000:00010000:3.0:1788448513.179559:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179569:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179576:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179584:0:5838:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179590:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179606:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179619:0:5838:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448513.179636:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179642:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179648:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179654:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448513.179658:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179665:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179673:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674100) 00010000:00010000:3.0:1788448513.179676:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788448513.179679:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179685:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab541 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179699:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179704:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179714:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179719:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448513.179722:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179727:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179734:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448513.179736:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448513.179739:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.179744:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab533 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448513.179753:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a5cb4227 reply state 0000000046285156 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.179761:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448513.179840:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+32:10496:x1875323902803328:12345-192.168.204.37@tcp:36:rm.0 Request processed in 1738us (1964us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1788448513.179848:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00010000:00010000:0.0:1788448513.181209:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448513.181220:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.181230:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448513.181234:0:11159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.181243:0:11159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.181256:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff99a829674100) 00010000:00010000:0.0:1788448513.181259:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448513.181262:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.181268:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab548 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.181288:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448513.181290:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448513.181292:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448513.185956:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.185973:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.185981:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.185988:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448513.185992:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.185999:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.186017:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674e00) 00010000:00010000:2.0:1788448513.186020:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448513.186025:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.186031:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab53a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448513.258693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.259398:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803584 00000100:00100000:3.0:1788448513.259410:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803584 00000100:00100000:3.0:1788448513.259534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:3.0:1788448513.259547:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+31:10502:x1875323902803584:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448513.259608:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448513.259632:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab54f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b15 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259765:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259779:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259791:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259805:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259812:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.259818:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448513.260996:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1788448513.261434:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261449:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261460:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261510:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261517:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261525:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261530:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448513.261534:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261541:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261554:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448513.261557:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448513.261562:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261701:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab556 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448513.261718:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001a70e791 reply state 00000000f49fe2e3 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.261726:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788448513.261760:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab54f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261789:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 33 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.261797:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448513.261800:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448513.261802:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030c00, rc 0) 00000100:00100000:3.0:1788448513.261956:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:10502:x1875323902803584:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2410us (3272us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1788448513.261965:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 96 00010000:00010000:2.0:1788448513.267614:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267634:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267641:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267647:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448513.267652:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267659:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267677:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674300) 00010000:00010000:2.0:1788448513.267680:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448513.267684:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.267690:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab55d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448513.268690:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448513.268925:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803712 00000100:00100000:0.0:1788448513.268937:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803712 00000100:00100000:0.0:1788448513.269023:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1788448513.269035:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902803712:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448513.269055:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448513.269075:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b1c expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448513.269106:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788448513.269126:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=373s v=(0 0) 00010000:00010000:0.0:1788448513.269131:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448513.269141:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.269169:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 6 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.269182:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed800, rc 0) 00000100:00100000:0.0:1788448513.269286:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902803712:12345-192.168.204.37@tcp:101:bash.0 Request processed in 253us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448513.269292:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1788448513.273146:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448513.273321:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803840 00000100:00100000:2.0:1788448513.273331:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803840 00000100:00100000:2.0:1788448513.273375:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:2.0:1788448513.273383:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:10502:x1875323902803840:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448513.273415:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448513.273432:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b23 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.273460:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.273468:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448513.273472:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448513.273478:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.273510:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.273524:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 7 pid: 6683 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448513.273539:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875323926939136:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448513.273632:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448513.277089:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.277218:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902803968 00000100:00100000:3.0:1788448513.277229:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902803968 00010000:00010000:3.0:1788448513.277289:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 8 pid: 6683 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.277336:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1788448513.277349:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804615050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902803968:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448513.277363:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448513.277386:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 8 pid: 6683 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.277399:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 8 pid: 6683 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.277424:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448513.277444:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448513.277453:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.277463:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.277503:0:6696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.277517:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6696:1875323926939264:192.168.204.37@tcp:105: 00000100:00100000:3.0:1788448513.277595:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fbb40 going to sleep for 11 seconds 00010000:00010000:1.0:1788448513.278013:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f89ce73/0xd0e9b344b90ab572 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b1c expref: 8 pid: 6683 timeout: 473 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448513.278031:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6680:1875323926939136:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448513.278056:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 7 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.278067:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179e00, rc 0) 00000100:00100000:1.0:1788448513.278108:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:10502:x1875323902803840:12345-192.168.204.37@tcp:101:bash.0 Request processed in 4726us (4973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448513.278116:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:3.0:1788448513.281997:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:6696:1875323926939264:192.168.204.37@tcp:105: 00010000:00010000:3.0:1788448513.282041:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448513.282103:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804615050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902803968:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 4756us (5022us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.282115:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1788448513.291639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448513.291741:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902804224 00000100:00100000:2.0:1788448513.291750:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902804224 00000100:00100000:2.0:1788448513.291804:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:2.0:1788448513.291814:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+33:10502:x1875323902804224:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:2.0:1788448513.292176:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:10502:x1875323902804224:12345-192.168.204.37@tcp:35:bash.0 Request processed in 361us (546us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788448513.292805:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00010000:00010000:2.0:1788448513.568482:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448513.627756:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.628020:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902804352 00000100:00100000:3.0:1788448513.628031:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902804352 00000100:00100000:3.0:1788448513.628096:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:3.0:1788448513.628107:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+34:10518:x1875323902804352:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448513.628137:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448513.628170:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab580 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b2a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628297:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628312:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628324:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448513.628358:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788448513.628362:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448513.628380:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628404:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab580 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b2a expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628423:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b2a expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.628432:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448513.628435:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448513.628439:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030000, rc 0) 00000100:00100000:3.0:1788448513.628505:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+35:10518:x1875323902804352:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 399us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.628512:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:2.0:1788448513.633592:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448513.633626:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448513.633707:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448513.634690:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926939392 00000100:00100000:3.0:1788448513.634700:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926939392 00000100:00080000:0.0:1788448513.634990:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448513.634998:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448513.635221:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926939392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448513.635263:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448513.635570:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926939392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 563us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.635578:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788448513.635636:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926939392:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448513.637386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448513.637487:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902804608 00000100:00100000:1.0:1788448513.637496:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902804608 00000100:00100000:1.0:1788448513.637555:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:1.0:1788448513.637576:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+35:10518:x1875323902804608:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448513.637597:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448513.637629:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab58e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b31 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.637733:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab595 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.638097:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.638131:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab595 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448513.638157:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1788448513.638359:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90ab58e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b31 expref: 38 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.638379:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab595 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b31 expref: 37 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.638387:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448513.638390:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448513.638393:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9de00, rc 0) 00000100:00100000:1.0:1788448513.638461:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+37:10518:x1875323902804608:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 886us (1071us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788448513.638469:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:0.0:1788448513.645088:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448513.645364:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902804864 00000100:00100000:2.0:1788448513.645375:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902804864 00000100:00100000:2.0:1788448513.645437:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1788448513.645447:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+37:10518:x1875323902804864:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448513.646567:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448513.646596:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab5a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b38 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.646708:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.646734:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.646747:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448513.646759:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788448513.646889:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179200/0xd0e9b344b90ab5a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b38 expref: 40 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.646910:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b38 expref: 39 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448513.646935:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:2.0:1788448513.646938:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448513.646941:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:2.0:1788448513.647021:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+39:10518:x1875323902804864:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1574us (1945us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788448513.647029:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1788448513.648214:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.648403:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902804992 00000100:00100000:3.0:1788448513.648412:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902804992 00000100:00100000:3.0:1788448513.648494:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:3.0:1788448513.648506:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+39:2353:x1875323902804992:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448513.648519:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448513.648541:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab595 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b31 expref: 39 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.648560:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448513.648575:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448513.648616:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+38:2353:x1875323902804992:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 111us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.648624:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:2.0:1788448513.678694:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448513.678927:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805120 00000100:00100000:1.0:1788448513.678937:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805120 00000100:00100000:1.0:1788448513.679032:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:1.0:1788448513.679043:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902805120:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:1.0:1788448513.679105:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.679128:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.679137:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788448513.679171:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448513.679177:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.679245:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 6 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.679259:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 6 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448513.679276:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875323926939520:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448513.679373:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a829734b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448513.684872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.686016:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805248 00000100:00100000:3.0:1788448513.686031:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805248 00002000:00100000:3.0:1788448513.686087:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99a834d38a80 x1875323902805248/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:749/0 lens 504/0 e 0 to 0 dl 1788448524 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448513.686097:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a834d38a80 with x1875323902805248 ext(0->8) 00010000:00010000:3.0:1788448513.686107:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 7 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.686156:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 7 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448513.686163:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a834d38a80 00000100:00100000:3.0:1788448513.686247:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448513.686267:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902805248:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:3.0:1788448513.686768:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902805248:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 510us (1903us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1788448513.686776:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00002000:00100000:3.0:1788448513.686784:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff99a834d38a80 x1875323902805248/t4294967302(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:749/0 lens 504/448 e 0 to 0 dl 1788448524 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448513.686793:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a834d38a80 with x1875323902805248 ext(0->8) 00010000:00010000:3.0:1788448513.686799:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.687694:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448513.687703:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a834d38a80 00000100:00100000:2.0:1788448513.689983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.690089:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805376 00000100:00100000:3.0:1788448513.690099:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805376 00010000:00010000:3.0:1788448513.690455:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.690557:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1788448513.690568:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902805376:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448513.690582:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1788448513.690603:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1788448513.690606:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1788448512 00002000:00010000:3.0:1788448513.690608:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1788448512 00002000:00010000:3.0:1788448513.690610:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1788448512 00010000:00010000:3.0:1788448513.690618:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.690633:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 9 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.690658:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448513.690663:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448513.690668:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.690678:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.690709:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448513.690767:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902805376:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 201us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.690775:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00010000:00010000:1.0:1788448513.692493:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b8d43ab7/0xd0e9b344b90ab579 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b23 expref: 8 pid: 6680 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448513.692521:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c7100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875323926939520:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448513.692546:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692557:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692564:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692597:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692629:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692637:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692644:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448513.692649:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692658:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692674:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.692682:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab5b8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448513.692782:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902805120:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 13740us (14098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448513.692792:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:1.0:1788448513.699493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.699623:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805632 00000100:00100000:3.0:1788448513.699633:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805632 00000100:00100000:3.0:1788448513.699694:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1788448513.699704:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+38:10518:x1875323902805632:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:3.0:1788448513.699774:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b38 expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448513.700114:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:3.0:1788448513.700182:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:3.0:1788448513.700858:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:3.0:1788448513.700918:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.700936:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.700944:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.700982:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.700998:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 42 pid: 5837 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448513.701013:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875323926939648:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448513.701481:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448513.714578:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.715391:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875323926939648:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448513.715444:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448513.717939:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805760 00000100:00100000:2.0:1788448513.717955:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805760 00010000:00010000:0.0:1788448513.718445:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 43 pid: 5837 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448513.718553:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1788448513.718564:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+43:2352:x1875323902805760:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448513.718581:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448513.718589:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 43 pid: 5837 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718603:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 43 pid: 5837 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718759:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab564 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b15 expref: 43 pid: 5837 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718780:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448513.718786:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718795:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718815:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.718850:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448513.719083:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.719092:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448513.719267:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1788448513.719487:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1788448513.719601:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926939776:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788448513.720074:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+44:2352:x1875323902805760:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 1509us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448513.720084:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:3.0:1788448513.720252:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448513.720293:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fbd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448513.720965:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926939776 00000100:00100000:1.0:1788448513.720977:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926939776 00000100:00100000:1.0:1788448513.721235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448513.721246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926939776:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788448513.721343:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926939776:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 100us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448513.721350:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448513.721698:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788448513.721714:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1788448513.721735:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a83fc67800, transno 4294967301 00000100:00100000:0.0:1788448513.721755:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926939776:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788448513.724360:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1788448513.724480:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d39180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926939904:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788448513.724548:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448513.724591:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448513.725973:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926939904 00000100:00100000:1.0:1788448513.725989:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926939904 00000100:00100000:1.0:1788448513.726081:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448513.726092:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926939904:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788448513.726738:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875323926939904:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 645us (2187us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1788448513.726747:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448513.727836:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d39180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926939904:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788448513.727948:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1788448513.728015:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728027:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728035:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728041:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448513.728387:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728399:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728419:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448513.728422:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788448513.728428:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448513.728455:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab5bf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448513.730577:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788448513.730791:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:0.0:1788448513.730814:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 374337628025ns, next at 375337624040ns, rc = 0 00000001:00080000:0.0:1788448513.730825:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1788448513.731841:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448513.731848:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788448513.731859:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178800/0xd0e9b344b90ab5aa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b38 expref: 46 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448513.732445:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace2c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+45:10518:x1875323902805632:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 32740us (32960us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1788448513.732456:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000020:00080000:0.0:1788448513.732462:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00080000:3.0:1788448513.732903:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448513.749547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448513.749819:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902805888 00000100:00100000:3.0:1788448513.749832:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902805888 00000100:00100000:3.0:1788448513.751111:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:3.0:1788448513.751157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+45:10518:x1875323902805888:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448513.751210:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448513.751241:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab5c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b3f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.751316:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b3f expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.751332:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab5c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b3f expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448513.751375:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448513.751379:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448513.751383:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030400, rc 0) 00000100:00100000:3.0:1788448513.751460:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+46:10518:x1875323902805888:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 337us (1923us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448513.751469:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:1.0:1788448513.772306:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448513.772679:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902806144 00000100:00100000:2.0:1788448513.772691:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902806144 00000100:00100000:2.0:1788448513.772824:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:2.0:1788448513.772835:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+46:10518:x1875323902806144:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448513.773137:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+47:10518:x1875323902806144:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 295us (833us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1788448513.773157:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:2.0:1788448513.948659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448513.948948:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902806272 00000100:00100000:1.0:1788448513.948965:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902806272 00000100:00100000:1.0:1788448513.949066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:1.0:1788448513.949077:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+47:10528:x1875323902806272:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:1.0:1788448513.949170:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949224:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949238:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949254:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949282:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949290:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949394:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949402:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949410:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448513.949453:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949465:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949471:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949478:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949483:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448513.949487:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949506:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949525:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448513.949528:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448513.949533:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949539:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab5cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949552:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949558:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949564:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949568:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448513.949571:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949576:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949583:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf400) 00010000:00010000:1.0:1788448513.949585:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448513.949588:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949593:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab5d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949630:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949638:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949643:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949648:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448513.949651:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949656:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949664:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448513.949666:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448513.949669:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448513.949674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab5db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448513.949766:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+47:10528:x1875323902806272:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 691us (1125us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448513.949775:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:1.0:1788448514.014807:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.015334:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902806528 00000100:00100000:0.0:1788448514.015349:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902806528 00000100:00100000:0.0:1788448514.015511:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:0.0:1788448514.015527:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:10531:x1875323902806528:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448514.015560:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448514.015604:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab5e2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b46 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015709:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015750:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015764:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015785:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015792:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015799:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015974:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab5f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015982:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.015990:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab5f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448514.016011:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1788448514.016160:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.016169:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.016175:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017746:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.017756:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017769:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017790:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448514.017793:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448514.017799:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017806:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab5e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017830:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017837:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017843:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017848:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.017851:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017857:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017889:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a80bd82f00) 00010000:00010000:0.0:1788448514.017892:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448514.017895:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.017901:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab5f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.018518:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab5e2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b46 expref: 50 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.018539:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab5f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b46 expref: 49 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.018548:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448514.018550:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448514.018553:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:0.0:1788448514.018665:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+49:10531:x1875323902806528:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 3141us (3871us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1788448514.018676:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00080000:3.0:1788448514.019133:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448514.023033:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.024111:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902806656 00000100:00100000:1.0:1788448514.024129:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902806656 00000100:00100000:1.0:1788448514.024262:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:1.0:1788448514.024275:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+49:10531:x1875323902806656:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448514.024378:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024401:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024415:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024452:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024460:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024466:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024472:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448514.024477:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024484:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024497:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448514.024501:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448514.024506:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.024523:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab605 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448514.025118:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+49:10531:x1875323902806656:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 842us (2098us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.025129:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:3.0:1788448514.029579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448514.029675:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902806912 00000100:00100000:2.0:1788448514.029687:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902806912 00000100:00100000:2.0:1788448514.029792:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1788448514.029804:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+49:10531:x1875323902806912:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448514.030147:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+50:10531:x1875323902806912:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 334us (572us total) trans 4294967391 rc 0/0 00000100:00100000:2.0:1788448514.030172:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1788448514.137796:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.137990:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902807168 00000100:00100000:1.0:1788448514.138072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902807168 00000100:00100000:1.0:1788448514.138292:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:1.0:1788448514.138306:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+50:10541:x1875323902807168:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448514.138344:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.138348:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788448514.138385:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b2a expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.138416:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:1.0:1788448514.138423:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448514.138544:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab60c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b4d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.138770:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.138786:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.138795:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448514.138805:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788448514.139037:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab60c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b4d expref: 52 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.139056:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b4d expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.139064:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:2.0:1788448514.139067:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448514.139070:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:2.0:1788448514.139379:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+51:10541:x1875323902807168:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1075us (1597us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788448514.139388:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 104 00000100:00100000:1.0:1788448514.142505:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448514.142794:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902807296 00000100:00100000:2.0:1788448514.142898:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902807296 00000100:00100000:2.0:1788448514.143036:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1788448514.143050:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:2353:x1875323902807296:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448514.143071:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448514.143118:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b4d expref: 51 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.143161:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:2.0:1788448514.143167:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448514.143286:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+50:2353:x1875323902807296:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 239us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448514.143295:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1788448514.145454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.146411:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902807552 00000100:00100000:3.0:1788448514.146428:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902807552 00000100:00100000:3.0:1788448514.146505:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:3.0:1788448514.146519:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+50:10541:x1875323902807552:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:3.0:1788448514.146598:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448514.146786:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab5f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b46 expref: 50 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.146812:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448514.146818:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448514.147496:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.147515:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.147526:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448514.147616:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1788448514.147719:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ad947e36 reply state 000000000de6c871 transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448514.147729:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448514.148008:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+52:10541:x1875323902807552:12345-192.168.204.37@tcp:36:bash.0 Request processed in 1481us (2555us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788448514.148018:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 105 00000020:00080000:3.0:1788448514.148025:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448514.151654:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151679:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151688:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151695:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448514.151702:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151710:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151732:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:2.0:1788448514.151736:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448514.151763:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.151770:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab621 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448514.152685:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.153145:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902807680 00000100:00100000:1.0:1788448514.153161:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902807680 00000100:00100000:1.0:1788448514.153282:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:1.0:1788448514.153294:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:10541:x1875323902807680:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448514.153328:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.153355:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab628 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b54 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153484:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153499:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153511:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448514.153545:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788448514.153550:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448514.153573:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153604:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab628 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 53 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153623:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 52 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.153645:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448514.153648:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448514.153652:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d600, rc 0) 00000100:00100000:1.0:1788448514.153722:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:10541:x1875323902807680:12345-192.168.204.37@tcp:101:bash.0 Request processed in 430us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.153730:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:1.0:1788448514.160997:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.161518:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902807936 00000100:00100000:3.0:1788448514.161531:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902807936 00000100:00100000:3.0:1788448514.161609:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:3.0:1788448514.161621:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+52:10541:x1875323902807936:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:3.0:1788448514.162562:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+53:10541:x1875323902807936:12345-192.168.204.37@tcp:35:bash.0 Request processed in 936us (1573us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1788448514.162574:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:0.0:1788448514.234758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.240082:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808064 00000100:00100000:1.0:1788448514.240139:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808064 00000100:00100000:3.0:1788448514.240688:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:3.0:1788448514.240706:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+53:10547:x1875323902808064:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448514.240742:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448514.240773:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab636 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b5b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.240880:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.240899:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.240923:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448514.240971:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1788448514.240976:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448514.240999:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.241031:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab636 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b5b expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.241056:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b5b expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.241066:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448514.241069:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448514.241075:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030e00, rc 0) 00000100:00100000:3.0:1788448514.241229:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902808064:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 529us (6485us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.241239:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:0.0:1788448514.249037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.250782:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808192 00000100:00100000:1.0:1788448514.250801:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808192 00000100:00100000:1.0:1788448514.251129:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:1.0:1788448514.251152:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902808192:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448514.251180:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.251273:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab644 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b62 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251364:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251384:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251399:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251419:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251426:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.251433:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252102:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252115:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252126:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448514.252228:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788448514.252233:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448514.252392:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252408:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252417:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252423:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252429:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252435:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448514.252440:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252447:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252463:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448514.252465:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448514.252471:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252477:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab64b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252506:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252512:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252518:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252523:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448514.252526:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252533:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252541:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a808bbf400) 00010000:00010000:3.0:1788448514.252543:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448514.252546:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252551:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252595:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab644 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b62 expref: 56 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252610:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b62 expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.252629:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448514.252631:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448514.252634:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030c00, rc 0) 00000100:00100000:3.0:1788448514.252733:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+55:10547:x1875323902808192:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1583us (3710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.252742:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:2.0:1788448514.263110:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448514.263234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.266002:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808576 00000100:00100000:0.0:1788448514.266025:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808576 00000100:00100000:0.0:1788448514.266158:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448514.266172:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:2352:x1875323902808576:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448514.266269:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448514.266303:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b62 expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.266333:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448514.266339:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448514.266414:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+54:2352:x1875323902808576:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 246us (3180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.266422:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1788448514.269379:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808448 00000100:00100000:3.0:1788448514.269401:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808448 00000100:00100000:3.0:1788448514.269482:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:3.0:1788448514.269494:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902808448:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448514.269536:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448514.269566:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab660 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b69 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.269757:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.269776:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.269788:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.269847:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.269864:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 55 pid: 7154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448514.269889:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926940032:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448514.270035:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448514.286347:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835ab9880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926940032:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448514.286396:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448514.292672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.293060:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808704 00000100:00100000:3.0:1788448514.293074:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808704 00010000:00010000:3.0:1788448514.293144:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 56 pid: 7154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448514.293241:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1788448514.293262:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+56:2353:x1875323902808704:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448514.293283:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448514.293292:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 56 pid: 7154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293309:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 56 pid: 7154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293338:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab62f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b54 expref: 56 pid: 7154 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293359:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448514.293365:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293396:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293405:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.293762:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448514.293848:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:2353:x1875323902808704:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 587us (1191us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.293859:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00010000:00010000:3.0:1788448514.293866:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.293875:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448514.293901:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788448514.294752:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab660 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.294779:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.294788:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448514.294791:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448514.294794:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800031000, rc 0) 00000100:00100000:3.0:1788448514.295696:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:10547:x1875323902808448:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 26198us (32594us total) trans 4294967396 rc 0/0 00000100:00100000:3.0:1788448514.295708:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:0.0:1788448514.327394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448514.330465:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902808960 00000100:00100000:2.0:1788448514.330488:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902808960 00000100:00100000:0.0:1788448514.334609:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1788448514.334629:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804614050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:10547:x1875323902808960:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:0.0:1788448514.334654:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448514.334690:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab5c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b3f expref: 55 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.334715:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448514.334721:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448514.334811:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804614050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902808960:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 187us (7433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.334820:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1788448514.343011:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.343099:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809088 00000100:00100000:3.0:1788448514.343112:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809088 00000100:00100000:3.0:1788448514.343222:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:3.0:1788448514.343234:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902809088:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:3.0:1788448514.343403:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.343423:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.343436:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448514.343669:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1788448514.343846:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902809088:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 612us (857us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.343856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:2.0:1788448514.348535:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.348801:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809216 00000100:00100000:1.0:1788448514.348815:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809216 00000100:00100000:1.0:1788448514.348893:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:1.0:1788448514.348905:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+54:10547:x1875323902809216:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448514.348954:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.348984:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b70 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349075:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349088:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349112:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349126:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349154:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448514.349158:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448514.349162:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.349170:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9da00, rc 0) 00000100:00100000:1.0:1788448514.349498:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:10547:x1875323902809216:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 593us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.349506:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 111 00010000:00010000:2.0:1788448514.593849:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448514.657033:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448514.657045:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448514.657091:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1788448514.657097:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448514.657301:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a80868c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926940160:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448514.659161:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448514.671948:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.672105:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a80868c380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926940160:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448514.672714:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809344 00000100:00100000:3.0:1788448514.672726:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809344 00000100:00100000:3.0:1788448514.672873:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:3.0:1788448514.672888:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+55:10548:x1875323902809344:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788448514.672936:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788448514.673137:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+55:10548:x1875323902809344:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 252us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.673146:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 112 00000100:00100000:1.0:1788448514.689363:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.691621:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809472 00000100:00100000:3.0:1788448514.691644:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809472 00000100:00100000:3.0:1788448514.691740:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:3.0:1788448514.691753:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:10548:x1875323902809472:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788448514.691872:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.691918:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.691935:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692499:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692522:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692535:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692569:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692578:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692585:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448514.692633:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788448514.692637:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448514.692650:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692662:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692687:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692694:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692700:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448514.692705:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692712:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692725:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:3.0:1788448514.692728:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448514.692732:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692739:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab683 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692769:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692776:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692782:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692787:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448514.692795:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692802:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692810:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff99a829674300) 00010000:00010000:3.0:1788448514.692926:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448514.692931:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692937:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab68a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692955:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692960:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692965:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692970:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448514.692972:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692978:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.692987:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448514.692989:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448514.692999:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.693005:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab691 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448514.693320:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:10548:x1875323902809472:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 1563us (3972us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.693331:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 113 00000100:00100000:2.0:1788448514.706784:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.711264:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809728 00000100:00100000:0.0:1788448514.711279:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809728 00000100:00100000:0.0:1788448514.711370:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:0.0:1788448514.711381:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+55:10548:x1875323902809728:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448514.711400:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448514.711421:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab698 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b77 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711517:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711531:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711541:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448514.711552:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788448514.711668:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711676:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711683:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711689:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.711694:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711720:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711733:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448514.711737:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448514.711741:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711748:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab69f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.711806:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab698 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b77 expref: 57 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.712246:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:0.0:1788448514.712249:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448514.712254:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab698 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b77 expref: 57 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.712267:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eca00, rc 0) 00000100:00100000:0.0:1788448514.712370:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902809728:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 990us (5597us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1788448514.712378:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 114 00000100:00100000:2.0:1788448514.716792:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.716940:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902809856 00000100:00100000:0.0:1788448514.716954:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902809856 00000100:00100000:1.0:1788448514.717181:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:1.0:1788448514.717216:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902809856:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788448514.717332:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788448514.717481:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902809856:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 270us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.717490:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 115 00000100:00100000:2.0:1788448514.725762:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.725856:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902810112 00000100:00100000:0.0:1788448514.725871:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902810112 00000100:00100000:0.0:1788448514.725950:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:0.0:1788448514.725963:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902810112:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448514.726011:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448514.726015:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448514.726050:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab63d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b5b expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.726074:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448514.726080:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448514.726097:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6ad lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b7e expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448514.726688:0:7154:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:0.0:1788448514.728776:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab6b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.728801:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.728815:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab6b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.728926:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6ad lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b7e expref: 58 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.728949:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab6b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b7e expref: 57 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.731676:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a80bd82f00) 00010000:00010000:0.0:1788448514.731680:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448514.731701:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:1.0:1788448514.733393:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+57:10548:x1875323902810112:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 7422us (7636us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1788448514.733405:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 116 00000100:00100000:2.0:1788448514.743053:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.743234:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902810368 00000100:00100000:0.0:1788448514.743251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902810368 00000100:00100000:0.0:1788448514.743317:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:0.0:1788448514.743327:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+57:10548:x1875323902810368:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448514.743389:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448514.743417:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab6b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b7e expref: 57 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743438:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a80bd82f00) 00010000:00010000:0.0:1788448514.743450:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448514.743471:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743484:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743493:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743513:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743520:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743526:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743591:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743613:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743619:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743624:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.743628:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743635:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743642:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448514.743645:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448514.743648:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743654:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab6c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743661:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743666:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743671:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743676:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.743682:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743687:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743693:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xcd5dd781 (ffff99a80bd82700) 00010000:00010000:0.0:1788448514.743695:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448514.743697:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.743702:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6c9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xcd5dd781 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448514.743786:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902810368:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 459us (749us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448514.743792:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 117 00000100:00100000:2.0:1788448514.750383:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.752302:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902810496 00000100:00100000:3.0:1788448514.752322:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902810496 00000100:00100000:3.0:1788448514.752415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:3.0:1788448514.752428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+56:10548:x1875323902810496:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448514.752467:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448514.752501:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab6d0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b85 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752559:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752575:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752589:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752729:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab6d0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752755:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.752790:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:3.0:1788448514.752795:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448514.752801:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030400, rc 0) 00000100:00100000:3.0:1788448514.753429:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+57:10548:x1875323902810496:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 998us (3056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.753438:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 118 00000100:00100000:2.0:1788448514.772508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.775537:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902810752 00000100:00100000:0.0:1788448514.775553:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902810752 00000100:00100000:0.0:1788448514.775638:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:0.0:1788448514.775664:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+57:10548:x1875323902810752:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448514.775893:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.775929:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.775943:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448514.776379:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:0.0:1788448514.776402:0:5838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 375383215225ns, next at 376383211600ns, rc = 0 00000004:00010000:0.0:1788448514.776514:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000150d7d4f reply state 0000000099bf72ef transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448514.776524:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448514.776629:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:10548:x1875323902810752:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 980us (4137us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1788448514.776637:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 119 00000100:00100000:2.0:1788448514.784921:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.785047:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902810880 00000100:00100000:1.0:1788448514.785066:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902810880 00000100:00100000:1.0:1788448514.785166:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 120 00000100:00100000:1.0:1788448514.785178:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+59:10548:x1875323902810880:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448514.785269:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.785294:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b8c expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.785394:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 60 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.785412:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 60 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.785448:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448514.785452:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448514.785457:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c400, rc 0) 00000100:00100000:1.0:1788448514.785526:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+60:10548:x1875323902810880:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 350us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.785551:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 120 00010000:00010000:0.0:1788448514.787625:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787647:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787654:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787660:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448514.787667:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787676:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787711:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:0.0:1788448514.787714:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448514.787719:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.787725:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ab6de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448514.800327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.801302:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902811008 00000100:00100000:1.0:1788448514.801326:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902811008 00000100:00100000:1.0:1788448514.801449:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:1.0:1788448514.801461:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902811008:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788448514.801826:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902811008:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 366us (1525us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1788448514.801834:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00080000:3.0:1788448514.803264:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448514.810007:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.810245:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902811264 00000100:00100000:1.0:1788448514.810270:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902811264 00000100:00100000:1.0:1788448514.810373:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:1.0:1788448514.810387:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+59:10548:x1875323902811264:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788448514.810787:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+60:10548:x1875323902811264:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 402us (809us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1788448514.810798:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:2.0:1788448514.825426:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.825766:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902811520 00000100:00100000:0.0:1788448514.825784:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902811520 00000100:00100000:0.0:1788448514.825892:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:0.0:1788448514.825909:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+60:10548:x1875323902811520:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788448514.826154:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+60:10548:x1875323902811520:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 250us (745us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.826163:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 121 00000100:00100000:2.0:1788448514.831911:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.831991:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902811648 00000100:00100000:1.0:1788448514.832004:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902811648 00000100:00100000:1.0:1788448514.832075:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:1.0:1788448514.832087:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+60:10548:x1875323902811648:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448514.832118:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.832155:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab6ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b93 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832323:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832364:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832379:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448514.832424:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448514.832445:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832474:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab6ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b93 expref: 62 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832493:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b93 expref: 61 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.832503:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448514.832507:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448514.832511:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d000, rc 0) 00000100:00100000:1.0:1788448514.832594:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835422d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+61:10548:x1875323902811648:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 509us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.832601:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:3.0:1788448514.844530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.845089:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902811776 00000100:00100000:1.0:1788448514.845105:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902811776 00000100:00100000:1.0:1788448514.845268:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:1.0:1788448514.845282:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902811776:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448514.845312:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448514.845367:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510b9a expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448514.845405:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998f01, blocks: 0x1 00010000:00010000:1.0:1788448514.845437:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788448514.845442:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448514.845454:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.845476:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 10 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448514.845495:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9de00, rc 0) 00000100:00100000:1.0:1788448514.845614:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:2352:x1875323902811776:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 335us (1103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448514.845623:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:0.0:1788448514.854802:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448514.855378:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812032 00000100:00100000:3.0:1788448514.855394:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812032 00000100:00100000:3.0:1788448514.855541:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:3.0:1788448514.855558:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+61:10548:x1875323902812032:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788448514.855749:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+61:10548:x1875323902812032:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 196us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448514.855758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 123 00000100:00100000:2.0:1788448514.860730:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.860970:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812160 00000100:00100000:0.0:1788448514.861052:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812160 00000100:00100000:0.0:1788448514.861218:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1788448514.861231:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+10:10548:x1875323902812160:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448514.861379:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448514.861405:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ba1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.861447:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.861457:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448514.861462:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448514.861468:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.861511:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.861545:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448514.861565:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875323926940288:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448514.861712:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41900 going to sleep for 11 seconds 00000100:00100000:2.0:1788448514.866081:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.866274:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875323926940288:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448514.866335:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 11 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448514.866367:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eca00, rc 0) 00000100:00100000:0.0:1788448514.866451:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+11:10548:x1875323902812160:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 5223us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.866461:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:3.0:1788448514.869392:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812288 00000100:00100000:3.0:1788448514.869416:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812288 00010000:00010000:3.0:1788448514.869489:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448514.869555:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:3.0:1788448514.869713:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+11:2353:x1875323902812288:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448514.869740:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448514.869777:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.870153:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.870513:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ab6fa lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b9a expref: 11 pid: 6682 timeout: 475 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.870543:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448514.870550:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448514.870563:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448514.870574:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448514.870784:0:6696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448514.870931:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6696:1875323926940416:192.168.204.37@tcp:105: 00000100:00100000:2.0:1788448514.871222:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8064823c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448514.882558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448514.883617:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6696:1875323926940416:192.168.204.37@tcp:105: 00010000:00010000:0.0:1788448514.883660:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448514.883751:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+10:2353:x1875323902812288:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 14185us (17689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448514.883768:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:3.0:1788448514.884071:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812416 00000100:00100000:3.0:1788448514.884082:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812416 00002000:00100000:3.0:1788448514.884160:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99a83ce35c00 x1875323902812416/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:750/0 lens 504/0 e 0 to 0 dl 1788448525 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448514.884171:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83ce35c00 with x1875323902812416 ext(0->12) 00002000:00010000:3.0:1788448514.884178:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83ce35c00 00000100:00100000:3.0:1788448514.884347:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1788448514.884361:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+10:2352:x1875323902812416:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788448514.889068:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+12:2352:x1875323902812416:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 4686us (6506us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788448514.889107:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00002000:00100000:2.0:1788448514.889135:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff99a83ce35c00 x1875323902812416/t4294967308(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:750/0 lens 504/448 e 0 to 0 dl 1788448525 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788448514.889146:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83ce35c00 with x1875323902812416 ext(0->12) 00002000:00010000:2.0:1788448514.889154:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83ce35c00 00000100:00100000:2.0:1788448514.897763:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448514.897961:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812544 00000100:00100000:1.0:1788448514.897976:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812544 00000100:00100000:1.0:1788448514.899491:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:1.0:1788448514.899520:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+61:10548:x1875323902812544:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788448515.026320:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1788448515.026340:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000004:00080000:2.0:1788448515.026371:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1788448515.026393:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a807d2a480 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1788448515.026399:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83cb63600 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a807d2a9c0 00000020:00080000:2.0:1788448515.026402:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83cb63d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a8297f7800 00000020:00080000:2.0:1788448515.026415:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a807d2a300 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1788448515.026438:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83cb63300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a807d2a3c0 00000020:00080000:2.0:1788448515.026441:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83cb63f00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a806d26000 00000001:00080000:2.0:1788448515.026460:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000020:00080000:2.0:1788448515.026640:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 0 00000020:00080000:2.0:1788448515.026861:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1788448515.026880:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926940672:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788448515.026881:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926940544:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788448515.027052:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448515.027327:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926940544 00000100:00100000:1.0:1788448515.027340:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926940544 00000100:00100000:1.0:1788448515.027429:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448515.027441:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926940544:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788448515.027479:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1788448515.027525:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a998f00, atime: 0x6a998f00, ctime: 0x6a998f00, blocks: 0x1 00010000:00010000:1.0:1788448515.027544:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.027565:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=375s v=(0 0) 00010000:00010000:1.0:1788448515.027571:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448515.027579:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.027599:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.027610:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.027619:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788448515.027709:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1788448515.027755:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:2.0:1788448515.027788:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:0.0:1788448515.027989:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788448515.028467:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788448515.029232:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926940800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788448515.030596:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788448515.030620:0:6683:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788448515.031148:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926940544:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3703us (4090us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1788448515.031161:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448515.031210:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926940672 00000100:00100000:1.0:1788448515.031223:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926940672 00000100:00100000:1.0:1788448515.031295:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788448515.031306:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926940672:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788448515.031344:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:1.0:1788448515.031379:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031430:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031441:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:1.0:1788448515.031447:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448515.031453:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031512:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 11 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031530:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 11 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.031547:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926940928:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448515.031646:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a805027840 going to sleep for 11 seconds 00010000:00010000:1.0:1788448515.031667:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448515.031675:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031685:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448515.031691:0:11159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031702:0:11159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031731:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031738:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008d7a0abd/0xd0e9b344b90ab708 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.031761:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448515.031763:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448515.031765:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448515.031995:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+15:10548:x1875323902812544:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 132490us (134249us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448515.032006:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00000004:00080000:0.0:1788448515.034419:0:3309:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a834f76a00/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788448515.034442:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f76a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926940544:0@lo:6:osp-syn-1-0.0 00000100:00080000:2.0:1788448515.037855:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448515.042483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448515.042562:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1788448515.042578:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926940800 00000100:00100000:2.0:1788448515.042590:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926940800 00000100:00100000:3.0:1788448515.043147:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.043181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.043226:0:6683:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788448515.043243:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812800 00000100:00100000:3.0:1788448515.043249:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812800 00000100:00100000:3.0:1788448515.043288:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902812672 00000100:00100000:3.0:1788448515.043292:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902812672 00010000:00010000:3.0:1788448515.043321:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.043356:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:3.0:1788448515.043369:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+13:2353:x1875323902812672:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448515.043388:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448515.043395:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.043412:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.043445:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448515.043449:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e2565e2/0xd0e9b344b90ab4ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b00 expref: 13 pid: 6680 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.043451:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448515.043459:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.043467:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926940928:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448515.043470:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.043615:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788448515.043626:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3311:x1875323926940800:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788448515.043864:0:12065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788448515.043868:0:12065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788448513 00002000:00010000:1.0:1788448515.043871:0:12065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1788448515.043873:0:12065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788448513 -> 1788448513 00002000:00010000:1.0:1788448515.043875:0:12065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1788448515.043942:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3311:x1875323926940800:12345-0@lo:2:osp-syn-0-0.0 Request processed in 317us (1463us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788448515.043950:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788448515.043970:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:1.0:1788448515.043977:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+12:2353:x1875323902812800:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00010000:00010000:2.0:1788448515.049948:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.050789:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448515.050916:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+12:2353:x1875323902812672:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 7540us (7766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.050930:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00010000:00010000:2.0:1788448515.052291:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.052314:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.052343:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.052352:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.052379:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1788448515.052397:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a835abbb80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1788448515.052409:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926940800:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788448515.053109:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3310:x1875323926940672:12345-0@lo:6:osp-syn-0-0.0 Request processed in 21801us (25116us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788448515.053132:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:3.0:1788448515.053169:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a835abad80/2, rc 0, transno 4294967310 00000100:00100000:3.0:1788448515.053175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926940672:0@lo:6:osp-syn-0-0.0 00010000:00010000:0.0:1788448515.053517:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448515.053528:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.053551:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448515.053557:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.053567:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.053594:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.053602:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ab70f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.053627:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448515.053629:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448515.053631:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788448515.166134:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:0.0:1788448515.166160:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:0.0:1788448515.166172:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1788448515.169502:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902812800:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 125506us (126302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.169520:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:2.0:1788448515.191643:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448515.191772:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813056 00000100:00100000:1.0:1788448515.191788:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813056 00000100:00100000:1.0:1788448515.191883:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 125 00000100:00100000:1.0:1788448515.191896:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+15:10548:x1875323902813056:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448515.191993:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448515.192033:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90ab6f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b93 expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.192059:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:1.0:1788448515.192066:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448515.192109:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.192137:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.192149:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448515.192571:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000093b287c0 reply state 0000000001b7420a transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.192584:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448515.192726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+16:10548:x1875323902813056:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 830us (1097us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788448515.192735:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 125 00010000:00010000:2.0:1788448515.199726:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199748:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199758:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199764:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448515.199769:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199777:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199799:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:2.0:1788448515.199832:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448515.199838:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.199845:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90ab716 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.207618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.208966:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813184 00000100:00100000:3.0:1788448515.208994:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813184 00000100:00100000:3.0:1788448515.209074:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:3.0:1788448515.209087:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902813184:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788448515.209400:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788448515.209405:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1788448513 -> 1788448513 00002000:00010000:3.0:1788448515.209408:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788448512 00002000:00010000:3.0:1788448515.209411:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1788448513 -> 1788448513 00002000:00010000:3.0:1788448515.209413:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788448515.209486:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902813184:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 401us (1884us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1788448515.209494:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:0.0:1788448515.213729:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.213959:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813440 00000100:00100000:3.0:1788448515.213974:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813440 00000100:00100000:3.0:1788448515.214107:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:3.0:1788448515.214130:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+15:10548:x1875323902813440:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788448515.214280:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.214300:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.214310:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.214356:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.214372:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 15 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.214390:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926941056:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448515.214510:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a820b2b840 going to sleep for 11 seconds 00000100:00100000:0.0:1788448515.230325:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448515.232988:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813568 00000100:00100000:2.0:1788448515.233012:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813568 00010000:00010000:2.0:1788448515.233098:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 16 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.233175:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:2.0:1788448515.233224:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:2352:x1875323902813568:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448515.233249:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448515.233259:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 16 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.233273:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 16 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.233304:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:2.0:1788448515.233310:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.233321:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.233329:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.233376:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448515.233478:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:2352:x1875323902813568:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 293us (3170us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448515.233488:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00010000:00010000:3.0:1788448515.236322:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab6d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b85 expref: 15 pid: 5837 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.236362:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926941056:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448515.236397:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236695:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236704:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236756:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236764:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236772:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236779:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448515.236784:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236793:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236830:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:0.0:1788448515.236834:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788448515.236840:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.236847:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab71d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448515.236962:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+14:10548:x1875323902813440:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 22833us (23247us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788448515.236975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 126 00000100:00100000:0.0:1788448515.243236:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448515.243398:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813696 00000100:00100000:2.0:1788448515.243412:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813696 00000100:00100000:2.0:1788448515.243491:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:2.0:1788448515.243506:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902813696:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788448515.243568:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.243593:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.243602:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448515.243607:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448515.243613:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.243663:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.243680:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 7 pid: 6683 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.243698:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926941184:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448515.243915:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448515.253387:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295aed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926941184:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448515.253441:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448515.258355:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.259659:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902813824 00000100:00100000:3.0:1788448515.259676:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902813824 00010000:00010000:3.0:1788448515.259736:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 8 pid: 6683 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.259795:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1788448515.259816:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902813824:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448515.259836:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448515.259869:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 8 pid: 6683 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.259888:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 8 pid: 6683 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.259918:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f4cc80/0xd0e9b344b90ab701 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba1 expref: 8 pid: 6683 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.259942:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448515.259947:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448515.259954:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.259966:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.260038:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448515.260136:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902813824:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 301us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.260145:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00010000:00010000:2.0:1788448515.260632:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260646:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260681:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260691:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260700:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260707:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448515.260712:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260723:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260751:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.260759:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90ab724 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.260860:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902813696:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 17357us (17685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448515.260870:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:0.0:1788448515.278691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448515.278853:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814080 00000100:00100000:1.0:1788448515.278869:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814080 00000100:00100000:1.0:1788448515.278955:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 127 00000100:00100000:1.0:1788448515.278977:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:10548:x1875323902814080:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788448515.279131:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279154:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279170:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279541:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279555:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279564:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279617:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.279637:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 15 pid: 7154 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.279657:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926941312:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448515.280294:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809018180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448515.292235:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448515.293334:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814208 00000100:00100000:2.0:1788448515.293352:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814208 00010000:00010000:2.0:1788448515.293422:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 16 pid: 7154 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448515.293482:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:2.0:1788448515.293495:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:2353:x1875323902814208:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448515.293515:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448515.293524:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 16 pid: 7154 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.293541:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 16 pid: 7154 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.293571:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:2.0:1788448515.293577:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.293605:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.293613:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.293639:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448515.293731:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:2353:x1875323902814208:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 239us (1557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448515.293740:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00010000:00010000:1.0:1788448515.293892:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab6e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b8c expref: 15 pid: 7154 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.293924:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926941312:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448515.293955:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.293966:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.293972:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448515.294294:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1788448515.294472:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1788448515.294524:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1788448515.294633:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926941440:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448515.294708:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448515.294754:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80af47540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448515.295471:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926941440 00000100:00100000:3.0:1788448515.295481:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926941440 00000100:00100000:3.0:1788448515.295539:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448515.295550:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875323926941440:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788448515.295707:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875323926941440:12345-0@lo:1000:mdt00_002.0 Request processed in 118us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.295717:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448515.296409:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1788448515.296419:0:5839:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967309 00000004:00080000:2.0:1788448515.296445:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a835abbb80, transno 4294967309 00000100:00100000:2.0:1788448515.296473:0:5839:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99a835abad80 x1875323926940672/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788448531 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448515.296492:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926941440:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1788448515.297574:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1788448515.297692:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926941568:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788448515.297774:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448515.297821:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bf00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448515.297913:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926941568 00000100:00100000:3.0:1788448515.297921:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926941568 00000100:00100000:3.0:1788448515.297983:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448515.297994:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875323926941568:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788448515.298273:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5839:x1875323926941568:12345-0@lo:1000:mdt00_002.0 Request processed in 280us (497us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788448515.298287:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448515.298532:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926941568:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1788448515.298577:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298588:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298596:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298604:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448515.298610:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298618:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298638:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a829674300) 00010000:00010000:0.0:1788448515.298641:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448515.298647:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298654:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab732 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298692:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298711:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298717:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298722:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448515.298726:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298732:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298741:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448515.298743:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448515.298750:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298763:0:5839:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298774:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.298808:0:5839:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448515.298822:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926941696:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448515.298916:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448515.303002:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926941696:192.168.204.37@tcp:105: 00010000:00010000:1.0:1788448515.303050:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab675 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303153:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303219:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303233:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303241:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303249:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303255:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448515.303260:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303269:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303283:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448515.303286:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448515.303290:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303296:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90ab739 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303307:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303313:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303324:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303330:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448515.303334:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303340:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303347:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:1.0:1788448515.303349:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448515.303351:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448515.303357:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab72b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.303688:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:10548:x1875323902814080:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 24711us (25010us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1788448515.303701:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 127 00000020:00080000:1.0:1788448515.303709:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788448515.303947:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448515.303953:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448515.304516:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1788448515.304526:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448515.306791:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448515.307056:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814336 00000100:00100000:0.0:1788448515.307069:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814336 00000100:00100000:0.0:1788448515.307149:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1788448515.307161:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:10547:x1875323902814336:12345-192.168.204.37@tcp:49:lfs.0 00000100:00100000:0.0:1788448515.307356:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:10547:x1875323902814336:12345-192.168.204.37@tcp:49:lfs.0 Request processed in 196us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448515.307364:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1788448515.310455:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448515.310509:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448515.310598:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814848 00000100:00100000:1.0:1788448515.310610:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814848 00000100:00100000:1.0:1788448515.310687:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:1.0:1788448515.310698:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:10547:x1875323902814848:12345-192.168.204.37@tcp:58:lfs.0 00000040:00080000:1.0:1788448515.311255:0:7154:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1788448515.311366:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:10547:x1875323902814848:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 668us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448515.311389:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 128 00000100:00100000:3.0:1788448515.311997:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814592 00000100:00100000:3.0:1788448515.312006:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814592 00000100:00100000:3.0:1788448515.312057:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1788448515.312067:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:10548:x1875323902814592:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788448515.320940:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788448515.321105:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1788448515.322503:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322525:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322603:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322612:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322619:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322639:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.322750:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788448515.322878:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace1c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+20:10548:x1875323902814592:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 10806us (12432us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1788448515.322889:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000020:00080000:0.0:1788448515.322897:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448515.323343:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448515.323352:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.323421:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448515.323426:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.323435:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.323449:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff99a80bd82700) 00010000:00010000:2.0:1788448515.323461:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1788448515.323467:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.323473:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab740 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448515.323492:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448515.323494:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448515.323495:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448515.351720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.352055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902814976 00000100:00100000:3.0:1788448515.352068:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902814976 00000100:00100000:3.0:1788448515.352233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 129 00000100:00100000:3.0:1788448515.352247:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+20:10550:x1875323902814976:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448515.352281:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448515.352308:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ba8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352392:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352409:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352424:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352442:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352450:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.352457:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.353170:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.353345:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.353356:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.353414:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.353431:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 21 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.353449:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926941824:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448515.354326:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807d2a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448515.360055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448515.360177:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902815232 00000100:00100000:1.0:1788448515.360219:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902815232 00000100:00100000:1.0:1788448515.360439:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:1.0:1788448515.360455:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:9233:x1875323902815232:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788448515.360543:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926941824:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448515.360578:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448515.362959:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+23:9233:x1875323902815232:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 2497us (2911us total) trans 4294967409 rc 0/0 00000100:00100000:1.0:1788448515.362973:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:2.0:1788448515.365486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448515.365600:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902815360 00000100:00100000:3.0:1788448515.365613:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902815360 00010000:00010000:3.0:1788448515.365674:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 23 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448515.365730:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1788448515.365740:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+23:2353:x1875323902815360:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448515.365759:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448515.365767:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 23 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365783:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 23 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365812:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab667 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b69 expref: 23 pid: 5838 timeout: 475 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365858:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448515.365865:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365878:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365887:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448515.365926:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448515.366002:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:2353:x1875323902815360:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 255us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.366010:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00010000:00010000:0.0:1788448515.366230:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366241:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448515.366299:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1788448515.366305:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448515.366329:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366344:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366355:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366377:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366384:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366391:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448515.366396:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366404:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366414:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:0.0:1788448515.366417:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448515.366422:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366429:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab74e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366443:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366450:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366456:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366460:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448515.366468:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366474:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366482:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff99a829674e00) 00010000:00010000:0.0:1788448515.366485:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448515.366488:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366494:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366535:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba8 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366550:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba8 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448515.366559:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448515.366561:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448515.366616:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030c00, rc 0) 00000100:00100000:0.0:1788448515.366651:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+21:10550:x1875323902814976:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 14408us (14944us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448515.366657:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 129 00010000:00010000:3.0:1788448515.621534:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448515.680863:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926942080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.680962:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448515.681035:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926942592:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681064:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448515.681100:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448515.681117:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926942208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681140:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448515.681180:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942592 00000100:00100000:3.0:1788448515.681212:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942592 00000100:00100000:3.0:1788448515.681291:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788448515.681303:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926942592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681368:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926942592:12345-0@lo:400:kworker.0 Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.681393:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788448515.681423:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942080 00000100:00100000:3.0:1788448515.681427:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942080 00000100:00100000:3.0:1788448515.681455:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942208 00000100:00100000:3.0:1788448515.681458:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942208 00000100:00100000:3.0:1788448515.681493:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788448515.681500:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926942080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681535:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926942080:12345-0@lo:400:kworker.0 Request processed in 35us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.681541:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788448515.681554:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788448515.681561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926942208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681589:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926942208:12345-0@lo:400:kworker.0 Request processed in 29us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.681594:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00080000:3.0:1788448515.681619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448515.681660:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835abbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926942208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681672:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835ab8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926942080:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.681682:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926942592:0@lo:400:kworker.0 00000100:00100000:2.0:1788448515.681829:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926941952:0@lo:400:kworker.0 00000100:00100000:2.0:1788448515.681869:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448515.681900:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926942464:0@lo:400:kworker.0 00000100:00100000:2.0:1788448515.681923:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448515.681940:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448515.681946:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926942336:0@lo:400:kworker.0 00000100:00100000:2.0:1788448515.681968:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448515.682276:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926941952 00000100:00100000:3.0:1788448515.682282:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926941952 00000100:00100000:3.0:1788448515.682361:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1788448515.682370:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926941952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.682414:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926941952:12345-0@lo:400:kworker.0 Request processed in 46us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.682435:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:0.0:1788448515.682540:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942464 00000100:00100000:0.0:1788448515.682545:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942464 00000100:00100000:0.0:1788448515.682587:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788448515.682595:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926942464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448515.682640:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926942464:12345-0@lo:400:kworker.0 Request processed in 47us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448515.682648:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788448515.685516:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942336 00000100:00100000:3.0:1788448515.685539:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942336 00000100:00100000:3.0:1788448515.685634:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788448515.685646:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926942336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.685763:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926942336:12345-0@lo:400:kworker.0 Request processed in 120us (3793us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448515.685770:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:3.0:1788448515.685806:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448515.685855:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926942336:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.685868:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926941952:0@lo:400:kworker.0 00000100:00100000:3.0:1788448515.685880:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926942464:0@lo:400:kworker.0 00000100:00100000:1.0:1788448516.196454:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448516.196490:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926942720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448516.196730:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448516.197089:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942720 00000100:00100000:3.0:1788448516.197112:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942720 00000100:00100000:3.0:1788448516.197438:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448516.197456:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926942720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448516.197509:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448516.197601:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926942720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448516.197678:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926942720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448516.211225:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000040:00080000:2.0:1788448516.346711:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448516.346725:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448516.346777:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788448516.346785:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448516.346971:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926942848:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448516.347117:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc900 going to sleep for 11 seconds 00000040:00080000:3.0:1788448516.351027:0:12103:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448516.351040:0:12103:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448516.351105:0:12103:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788448516.351112:0:12103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448516.361780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448516.361827:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902815488 00000100:00100000:1.0:1788448516.361839:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902815488 00000100:00100000:1.0:1788448516.361976:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00100000:1.0:1788448516.361994:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+22:10562:x1875323902815488:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788448516.362079:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788448516.362569:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+22:10562:x1875323902815488:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 575us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448516.362582:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 130 00000100:00080000:1.0:1788448516.362618:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448516.364872:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926942848:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448516.372930:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448516.373167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902815744 00000100:00100000:3.0:1788448516.373224:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902815744 00000100:00100000:3.0:1788448516.373304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:3.0:1788448516.373316:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:10562:x1875323902815744:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448516.373343:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448516.373372:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab763 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510baf expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448516.373869:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab76a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448516.373887:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448516.373902:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab76a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448516.373916:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788448516.374085:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab763 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510baf expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448516.374121:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab76a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510baf expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448516.374132:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448516.374136:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448516.374141:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030e00, rc 0) 00000100:00100000:3.0:1788448516.374254:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+23:10562:x1875323902815744:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 939us (1334us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1788448516.374263:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 131 00000100:00100000:0.0:1788448516.394453:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448516.394522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448516.394577:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816000 00000100:00100000:0.0:1788448516.394590:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816000 00000100:00100000:0.0:1788448516.394667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 132 00000100:00100000:0.0:1788448516.394679:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:10562:x1875323902816000:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448516.394793:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.394828:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.394844:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395119:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395129:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395137:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395144:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448516.395149:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395181:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395232:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448516.395235:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448516.395241:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.395248:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab778 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448516.395439:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+24:10562:x1875323902816000:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 760us (1001us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1788448516.395449:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 132 00000040:00080000:0.0:1788448516.395609:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448516.395615:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448516.396106:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788448516.396115:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448516.396230:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816128 00000100:00100000:0.0:1788448516.396238:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816128 00000100:00100000:0.0:1788448516.396296:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1788448516.396307:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804615450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+24:2354:x1875323902816128:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448516.396322:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448516.396343:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab76a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510baf expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448516.396362:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:0.0:1788448516.396366:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448516.396415:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804615450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:2354:x1875323902816128:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 110us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448516.396423:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1788448516.417903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448516.418052:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816384 00000100:00100000:2.0:1788448516.418065:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816384 00000100:00100000:2.0:1788448516.418167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:2.0:1788448516.418180:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:10562:x1875323902816384:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448516.418897:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+24:10562:x1875323902816384:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 718us (1008us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1788448516.418909:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00010000:00010000:0.0:1788448516.640341:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788448517.335518:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:3.0:1788448517.335731:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1788448517.558387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448517.558491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448517.558575:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448517.558600:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816768 00000100:00100000:2.0:1788448517.558601:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816640 00000100:00100000:2.0:1788448517.558609:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816640 00000100:00100000:0.0:1788448517.558609:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816768 00000100:00100000:2.0:1788448517.558657:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00100000:0.0:1788448517.558657:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:0.0:1788448517.558667:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902816768:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448517.558736:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+24:2352:x1875323902816640:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448517.558736:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902816768:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 71us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448517.558743:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00080000:0.0:1788448517.558764:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448517.558842:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+24:2352:x1875323902816640:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 107us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448517.558851:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00100000:1.0:1788448517.560756:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816512 00000100:00100000:1.0:1788448517.560766:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816512 00000100:00100000:1.0:1788448517.560924:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 290 00000100:00100000:1.0:1788448517.560947:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902816512:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448517.561018:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902816512:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 73us (2640us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448517.561026:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 290 00000100:00100000:0.0:1788448517.568305:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448517.568422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448517.571251:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817024 00000100:00100000:2.0:1788448517.571265:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817024 00000100:00100000:2.0:1788448517.571335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00100000:2.0:1788448517.571346:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902817024:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448517.571420:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902817024:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 77us (2998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448517.571428:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00080000:0.0:1788448517.571766:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448517.577015:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902816896 00000100:00100000:1.0:1788448517.577029:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902816896 00000100:00100000:1.0:1788448517.577437:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1788448517.577449:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902816896:12345-192.168.204.37@tcp:400:kworker.0 00000100:00080000:3.0:1788448517.577843:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448517.577988:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902816896:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 541us (9987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448517.577996:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00010000:00010000:1.0:1788448517.670615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448518.637533:0:12155:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448518.637547:0:12155:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448518.637599:0:12155:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1788448518.637606:0:12155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788448518.689395:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448518.753574:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926942976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448518.753713:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448518.753812:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926942976 00000100:00100000:3.0:1788448518.753821:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926942976 00000100:00100000:3.0:1788448518.753893:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448518.753905:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875323926942976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448518.753952:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448518.754016:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1875323926942976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448518.754024:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:3.0:1788448518.754060:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448518.754211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc67800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926942976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448518.872097:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448518.872145:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817280 00000100:00100000:3.0:1788448518.872159:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817280 00000100:00100000:3.0:1788448518.872268:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00100000:3.0:1788448518.872281:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+24:10583:x1875323902817280:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448518.872310:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448518.872339:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab77f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bb6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448518.872484:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab786 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448518.872502:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab786 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448518.872516:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab786 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448518.872530:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788448518.872698:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab77f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bb6 expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448518.872720:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab786 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bb6 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448518.872730:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448518.872733:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788448518.872737:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030e00, rc 0) 00000100:00100000:3.0:1788448518.872809:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+26:10583:x1875323902817280:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 531us (727us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788448518.872817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 133 00000100:00080000:3.0:1788448518.872846:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448518.899153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448518.900237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817408 00000100:00100000:2.0:1788448518.900252:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817408 00000100:00100000:2.0:1788448518.900338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:2.0:1788448518.900351:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:10583:x1875323902817408:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1788448518.900445:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900482:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900496:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900531:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900538:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900545:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900551:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448518.900556:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900564:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900577:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:2.0:1788448518.900580:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448518.900585:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448518.900592:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448518.902173:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:10583:x1875323902817408:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 1809us (3020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448518.902212:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 134 00000100:00100000:3.0:1788448519.028860:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448519.029060:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817536 00000100:00100000:0.0:1788448519.029074:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817536 00000100:00100000:0.0:1788448519.029239:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1788448519.029255:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902817536:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:0.0:1788448519.029279:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448519.029309:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ab79b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bbd expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448519.029347:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a998f01, atime: 0x6a998f00, ctime: 0x6a998f01, blocks: 0xb 00010000:00010000:0.0:1788448519.029393:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:0.0:1788448519.029400:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448519.029413:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ab79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bbd expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448519.029437:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ab79b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bbd expref: 7 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448519.029454:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:0.0:1788448519.029532:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902817536:12345-192.168.204.37@tcp:101:cat.0 Request processed in 281us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448519.029540:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00080000:3.0:1788448519.031079:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448519.040612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448519.040710:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817664 00000100:00100000:0.0:1788448519.040723:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817664 00002000:00100000:0.0:1788448519.040806:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99a83cdfca80 x1875323902817664/t0(0) o3->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:0/0 lens 488/0 e 0 to 0 dl 1788448530 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448519.040820:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83cdfca80 with x1875323902817664 ext(0->4095) 00002000:00010000:0.0:1788448519.040828:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83cdfca80 00000100:00100000:0.0:1788448519.040869:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1788448519.040881:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2354:x1875323902817664:12345-192.168.204.37@tcp:3:cat.0 00000100:00100000:0.0:1788448519.041249:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2354:x1875323902817664:12345-192.168.204.37@tcp:3:cat.0 Request processed in 368us (652us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788448519.041259:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00002000:00100000:0.0:1788448519.041268:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff99a83cdfca80 x1875323902817664/t0(0) o3->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:0/0 lens 488/4536 e 0 to 0 dl 1788448530 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448519.041291:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83cdfca80 with x1875323902817664 ext(0->4095) 00002000:00010000:0.0:1788448519.041295:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83cdfca80 00010000:00010000:0.0:1788448519.712426:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788448520.435044:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:2.0:1788448520.435073:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a80872bcc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1788448520.435080:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83504b300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a80872bb40 00000020:00080000:2.0:1788448520.435085:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a83504bc00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a806d24c00 00000001:00080000:2.0:1788448520.435135:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000020:00080000:2.0:1788448520.435147:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:2.0:1788448520.435155:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1788448520.435204:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1788448520.437786:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000001:00080000:3.0:1788448520.470417:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1788448520.470453:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000001:00080000:3.0:1788448520.470481:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000040:00080000:1.0:1788448520.480851:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448520.484658:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448520.484770:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1788448520.484779:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788448520.737513:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448520.800861:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926943104:0@lo:400:kworker.0 00000100:00100000:0.0:1788448520.800963:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448520.801149:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943104 00000100:00100000:1.0:1788448520.801160:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943104 00000100:00100000:1.0:1788448520.801243:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1788448520.801836:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926943104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802350:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926943232:0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802397:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448520.802436:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448520.802442:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926943360:0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448520.802494:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943232 00000100:00100000:3.0:1788448520.802499:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943232 00000100:00100000:3.0:1788448520.802538:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943360 00000100:00100000:3.0:1788448520.802541:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943360 00000100:00100000:3.0:1788448520.802571:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448520.802579:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926943232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802625:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926943232:12345-0@lo:400:kworker.0 Request processed in 46us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448520.802632:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788448520.802654:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788448520.802661:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926943360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802690:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926943360:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448520.802695:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788448520.802717:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448520.802754:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926943360:0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.802767:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926943232:0@lo:400:kworker.0 00000100:00100000:1.0:1788448520.803049:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926943104:12345-0@lo:400:kworker.0 Request processed in 1220us (2084us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448520.803057:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1788448520.804358:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926943488:0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.804436:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448520.807070:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448520.807098:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926943744:0@lo:400:kworker.0 00000100:00100000:2.0:1788448520.807206:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448520.807398:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448520.807417:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926943616:0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.807449:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448520.807488:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943616 00000100:00100000:3.0:1788448520.807497:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943616 00000100:00100000:3.0:1788448520.807568:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788448520.807578:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926943616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448520.807640:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926943616:12345-0@lo:400:kworker.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448520.807648:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:3.0:1788448520.807674:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448520.807709:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926943616:0@lo:400:kworker.0 00000100:00100000:2.0:1788448520.807890:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943488 00000100:00100000:2.0:1788448520.807895:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943488 00000100:00100000:2.0:1788448520.807938:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943744 00000100:00100000:2.0:1788448520.807941:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943744 00000100:00100000:2.0:1788448520.807962:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448520.807969:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448520.808019:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926943488:12345-0@lo:400:kworker.0 Request processed in 50us (3583us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448520.808025:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788448520.808037:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448520.808042:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926943744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448520.808069:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926943744:12345-0@lo:400:kworker.0 Request processed in 27us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448520.808085:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788448520.808112:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1788448520.808118:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a835abad80, transno 4294967310 00000004:00080000:2.0:1788448520.808129:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1788448520.808157:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835aff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926943488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448520.808177:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1788448520.808181:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1788448520.808229:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a834f76a00, transno 4294967304 00000100:00100000:2.0:1788448520.808238:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926943744:0@lo:400:kworker.0 00000100:00080000:3.0:1788448520.810893:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448520.810910:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448520.814528:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835ab9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926943104:0@lo:400:kworker.0 00000100:00100000:2.0:1788448521.312594:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926943872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448521.312702:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448521.312857:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926943872 00000100:00100000:0.0:1788448521.312868:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926943872 00000100:00100000:0.0:1788448521.312943:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788448521.312954:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926943872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448521.313011:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448521.313069:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926943872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448521.313077:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788448521.313448:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926943872:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448521.760639:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448522.700790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448522.700850:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448522.700878:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448522.700907:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448522.700949:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448522.701012:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818176 00000100:00100000:0.0:1788448522.701026:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818176 00000100:00100000:0.0:1788448522.701108:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818048 00000100:00100000:0.0:1788448522.701111:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818048 00000100:00100000:0.0:1788448522.701140:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:0.0:1788448522.701152:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902818176:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448522.701299:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902818176:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 148us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448522.701308:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:0.0:1788448522.701329:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:0.0:1788448522.701337:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902818048:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448522.701382:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902818048:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 46us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448522.701389:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:3.0:1788448522.701634:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817792 00000100:00100000:3.0:1788448522.701640:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817792 00000100:00100000:3.0:1788448522.701678:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 292 00000100:00100000:3.0:1788448522.701686:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902817792:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448522.701715:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902817792:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448522.701722:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 292 00000100:00100000:3.0:1788448522.701758:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902817920 00000100:00100000:3.0:1788448522.701761:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902817920 00000100:00100000:3.0:1788448522.701789:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818304 00000100:00100000:3.0:1788448522.701792:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818304 00000100:00100000:3.0:1788448522.701814:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:3.0:1788448522.701821:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:2353:x1875323902817920:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448522.701865:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:2353:x1875323902817920:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 45us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448522.701873:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:3.0:1788448522.701887:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:3.0:1788448522.701893:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902818304:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448522.701930:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902818304:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 37us (981us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448522.701937:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00080000:3.0:1788448522.701958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448522.701963:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448522.701966:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1788448522.784668:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448523.809415:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448523.873854:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926944000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448523.873936:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448523.876487:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944000 00000100:00100000:3.0:1788448523.876502:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944000 00000100:00100000:3.0:1788448523.876611:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788448523.876623:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926944000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448523.876665:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448523.876761:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926944000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (2825us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448523.876769:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788448523.877047:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926944000:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1788448523.877755:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448524.834993:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1788448525.485426:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:0.0:1788448525.485507:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1788448525.485528:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1788448525.490174:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448525.490500:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818432 00000100:00100000:0.0:1788448525.490578:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818432 00000100:00100000:0.0:1788448525.490653:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00100000:0.0:1788448525.490665:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:10227:x1875323902818432:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788448525.490777:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:10227:x1875323902818432:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 Request processed in 114us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448525.490786:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 135 00000100:00080000:3.0:1788448525.490978:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448525.498296:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448525.498382:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818688 00000100:00100000:2.0:1788448525.498394:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818688 00000100:00100000:2.0:1788448525.498575:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:2.0:1788448525.498587:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+13:10227:x1875323902818688:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788448525.499350:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+14:10227:x1875323902818688:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 761us (1060us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788448525.499359:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00010000:00010000:0.0:1788448525.856449:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448525.921154:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926944512:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921261:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921326:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788448525.921333:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926944128:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921363:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921386:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926944640:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921411:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921440:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926944256:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921463:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921493:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926944768:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921524:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921541:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448525.921546:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926944384:0@lo:400:kworker.0 00000100:00100000:1.0:1788448525.921567:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448525.921602:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944128 00000100:00100000:1.0:1788448525.921611:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944128 00000100:00100000:1.0:1788448525.921656:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1788448525.921665:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926944128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.921885:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944512 00000100:00100000:0.0:1788448525.921892:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944512 00000100:00100000:0.0:1788448525.921953:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944768 00000100:00100000:0.0:1788448525.921957:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944768 00000100:00100000:0.0:1788448525.921985:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788448525.921993:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926944512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448525.922138:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788448525.922149:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926944768:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788448525.922181:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448525.922236:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448525.922253:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944640 00000100:00100000:2.0:1788448525.922257:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944640 00000100:00100000:2.0:1788448525.922288:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944256 00000100:00100000:2.0:1788448525.922291:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944256 00000100:00100000:2.0:1788448525.922303:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944384 00000100:00100000:2.0:1788448525.922305:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944384 00000100:00100000:2.0:1788448525.922318:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788448525.922325:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926944640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.923698:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926944512:12345-0@lo:400:kworker.0 Request processed in 1698us (2429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448525.923729:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788448525.923796:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788448525.923806:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926944256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.923862:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926944256:12345-0@lo:400:kworker.0 Request processed in 58us (2397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448525.923868:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788448525.923882:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788448525.923889:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926944384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.924258:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926944384:12345-0@lo:400:kworker.0 Request processed in 369us (2688us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448525.924264:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788448525.924310:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926944384:0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.924322:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926944256:0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.924370:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926944128:0@lo:400:kworker.0 00000100:00100000:0.0:1788448525.924382:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926944512:0@lo:400:kworker.0 00000100:00080000:0.0:1788448525.924425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448525.927245:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926944128:12345-0@lo:400:kworker.0 Request processed in 5569us (5868us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448525.927261:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1788448525.930339:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926944768:12345-0@lo:400:kworker.0 Request processed in 8183us (8803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448525.930499:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926944768:0@lo:400:kworker.0 00000100:00100000:3.0:1788448525.930718:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788448525.934125:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926944640:12345-0@lo:400:kworker.0 Request processed in 11790us (12703us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448525.934140:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788448525.939826:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926944640:0@lo:400:kworker.0 00000100:00100000:2.0:1788448526.047616:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448526.048089:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818816 00000100:00100000:0.0:1788448526.048102:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818816 00000100:00100000:0.0:1788448526.048293:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00100000:0.0:1788448526.048320:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:11036:x1875323902818816:12345-192.168.204.37@tcp:101:lsof.0 00010000:00010000:0.0:1788448526.048343:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448526.048381:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab7a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bc4 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049398:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049419:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049431:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448526.049472:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788448526.049476:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448526.049524:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049556:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab7a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 7 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049579:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 6 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448526.049589:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:0.0:1788448526.049592:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448526.049596:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092edc00, rc 0) 00000100:00100000:0.0:1788448526.049729:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:11036:x1875323902818816:12345-192.168.204.37@tcp:101:lsof.0 Request processed in 1410us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448526.049754:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 136 00000100:00080000:2.0:1788448526.059517:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448526.432724:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926944896:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448526.432820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448526.432999:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926944896 00000100:00100000:3.0:1788448526.433008:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926944896 00000100:00100000:3.0:1788448526.433077:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788448526.433088:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926944896:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448526.433129:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448526.433214:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926944896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 128us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448526.433222:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788448526.433596:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926944896:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788448526.880478:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448527.802163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448527.802371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448527.802409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448527.802427:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448527.802433:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819200 00000100:00100000:2.0:1788448527.802444:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819200 00000100:00100000:3.0:1788448527.802453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448527.802486:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819456 00000100:00100000:3.0:1788448527.802490:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819456 00000100:00100000:2.0:1788448527.802511:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819328 00000100:00100000:3.0:1788448527.802512:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819072 00000100:00100000:2.0:1788448527.802513:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819328 00000100:00100000:3.0:1788448527.802514:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819072 00000100:00100000:3.0:1788448527.802534:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:3.0:1788448527.802545:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902819456:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448527.802625:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902819456:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 81us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448527.802633:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:3.0:1788448527.802651:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:3.0:1788448527.802657:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+14:2353:x1875323902819072:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448527.802704:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+14:2353:x1875323902819072:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448527.802711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00080000:3.0:1788448527.802734:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448527.802739:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448527.802741:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448527.802797:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:2.0:1788448527.802806:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902819200:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448527.802838:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902819200:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 33us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448527.802844:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:2.0:1788448527.802857:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:2.0:1788448527.802863:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902819328:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448527.802900:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902819328:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 38us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448527.802906:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:1.0:1788448527.803037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902818944 00000100:00100000:1.0:1788448527.803041:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902818944 00000100:00100000:1.0:1788448527.803089:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 294 00000100:00100000:1.0:1788448527.803096:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902818944:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448527.803136:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902818944:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 40us (985us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448527.803141:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 294 00010000:00010000:3.0:1788448527.906433:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448528.928445:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448528.993324:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448528.993347:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a810d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926945024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448528.993411:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448528.993641:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945024 00000100:00100000:2.0:1788448528.993650:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945024 00000100:00100000:2.0:1788448528.993724:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788448528.993734:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926945024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448528.993766:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448528.993820:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926945024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448528.993827:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448528.993919:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a810d6c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926945024:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448528.994120:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448529.955754:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788448530.587872:0:12358:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 11:15:28 (1788448528) 00000001:00080000:2.0:1788448530.593317:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000040:00080000:2.0:1788448530.720590:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448530.720601:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448530.722439:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:2.0:1788448530.722452:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788448530.982859:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448531.040515:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448531.040539:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926945152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448531.040570:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926945408:0@lo:400:kworker.0 00000100:00100000:1.0:1788448531.040607:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448531.040608:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448531.040722:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926945280:0@lo:400:kworker.0 00000100:00100000:0.0:1788448531.040891:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926945664:0@lo:400:kworker.0 00000100:00100000:2.0:1788448531.041215:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926945536:0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.041608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448531.041636:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926945792:0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.041663:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448531.041703:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945408 00000100:00100000:3.0:1788448531.041710:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945408 00000100:00100000:2.0:1788448531.041719:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448531.041751:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945792 00000100:00100000:2.0:1788448531.041755:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945792 00000100:00100000:3.0:1788448531.041777:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945280 00000100:00100000:3.0:1788448531.041780:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945280 00000100:00100000:2.0:1788448531.041782:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945536 00000100:00100000:2.0:1788448531.041785:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945536 00000100:00100000:3.0:1788448531.041804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788448531.041804:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788448531.041824:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926945408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448531.041825:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926945792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.041874:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926945408:12345-0@lo:400:kworker.0 Request processed in 51us (1265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448531.041881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788448531.041898:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788448531.041904:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926945280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.041934:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926945280:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448531.041939:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926945792:12345-0@lo:400:kworker.0 Request processed in 117us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448531.041945:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788448531.041952:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1788448531.041957:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00080000:3.0:1788448531.041972:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448531.041976:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448531.041979:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448531.042016:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926945280:0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.042027:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926945792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448531.042081:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926945536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.042094:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945152 00000100:00100000:3.0:1788448531.042098:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945152 00000100:00100000:2.0:1788448531.042120:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926945536:12345-0@lo:400:kworker.0 Request processed in 152us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448531.042125:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:2.0:1788448531.042126:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788448531.042131:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926945152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448531.042149:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926945536:0@lo:400:kworker.0 00000100:00100000:3.0:1788448531.042413:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926945152:12345-0@lo:400:kworker.0 Request processed in 281us (1802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448531.042420:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:3.0:1788448531.042457:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926945152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448531.052883:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926945408:0@lo:400:kworker.0 00000100:00100000:0.0:1788448531.060122:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448531.060904:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945664 00000100:00100000:1.0:1788448531.060914:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945664 00000100:00100000:1.0:1788448531.061004:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1788448531.061015:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926945664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448531.061076:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926945664:12345-0@lo:400:kworker.0 Request processed in 64us (962us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448531.061083:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788448531.061505:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926945664:0@lo:400:kworker.0 00000100:00080000:3.0:1788448531.063024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448531.552606:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448531.552638:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926945920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448531.552774:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448531.552862:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926945920 00000100:00100000:1.0:1788448531.552873:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926945920 00000100:00100000:1.0:1788448531.552940:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448531.552953:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926945920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448531.553012:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448531.553091:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926945920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 140us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448531.553099:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788448531.553392:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926945920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788448532.003251:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448532.594931:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448532.602266:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819712 00000100:00100000:3.0:1788448532.602288:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819712 00000100:00100000:3.0:1788448532.602738:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00100000:3.0:1788448532.602753:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+13:11302:x1875323902819712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448532.602794:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448532.602824:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab7b0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bcb expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.602928:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.602980:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.602997:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603016:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603023:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603030:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603436:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab7c5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603447:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603454:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab7c5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448532.603466:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:3.0:1788448532.603627:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603635:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603642:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603656:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448532.603661:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603669:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603684:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:3.0:1788448532.603687:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448532.603692:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603699:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ab7b7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603714:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603720:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603726:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603732:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448532.603735:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603741:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603761:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a829674b00) 00010000:00010000:3.0:1788448532.603763:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448532.603766:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.603772:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ab7be lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.604384:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ab7b0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bcb expref: 16 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.604404:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab7c5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bcb expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448532.604413:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:3.0:1788448532.604415:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448532.604418:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030400, rc 0) 00000100:00100000:3.0:1788448532.604510:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+15:11302:x1875323902819712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1760us (9597us total) trans 4294967415 rc 0/0 00000100:00100000:3.0:1788448532.604521:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 137 00000100:00080000:0.0:1788448532.610675:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448532.615903:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448532.616280:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448532.616402:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819968 00000100:00100000:2.0:1788448532.616417:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819968 00000100:00100000:2.0:1788448532.616509:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448532.616523:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+15:2354:x1875323902819968:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448532.616543:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448532.616588:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ab7c5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bcb expref: 15 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448532.616614:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:2.0:1788448532.616621:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448532.616699:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:2354:x1875323902819968:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 180us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448532.616707:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1788448532.621173:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902819840 00000100:00100000:1.0:1788448532.621209:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902819840 00000100:00100000:1.0:1788448532.621297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 138 00000100:00100000:1.0:1788448532.621312:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:11302:x1875323902819840:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788448532.623289:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:11302:x1875323902819840:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 1963us (7386us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448532.623307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 138 00000040:00080000:1.0:1788448532.775110:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788448532.775134:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788448532.776480:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788448532.776502:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448532.921327:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448532.921393:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820096 00000100:00100000:1.0:1788448532.921408:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820096 00000100:00100000:1.0:1788448532.921489:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 296 00000100:00100000:1.0:1788448532.921503:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902820096:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448532.921601:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:188c2354-2939-43ce-85d0-cb78875d8855+13:2352:x1875323902820096:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 100us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448532.921610:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 296 00000100:00100000:3.0:1788448532.933273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448532.933330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448532.933380:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448532.933417:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820224 00000100:00100000:3.0:1788448532.933429:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820224 00000100:00100000:3.0:1788448532.933535:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820352 00000100:00100000:3.0:1788448532.933539:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820352 00000100:00100000:3.0:1788448532.933569:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:3.0:1788448532.933581:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902820224:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448532.933687:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902820224:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 107us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448532.933695:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 91 00000100:00100000:3.0:1788448532.933715:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:3.0:1788448532.933722:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902820352:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448532.933748:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902820352:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448532.933754:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:3.0:1788448532.933795:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820480 00000100:00100000:3.0:1788448532.933799:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820480 00000100:00100000:3.0:1788448532.933836:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:3.0:1788448532.933842:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902820480:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448532.933873:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902820480:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 31us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448532.933879:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00080000:1.0:1788448532.934404:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788448532.934414:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448532.934416:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788448533.024451:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448534.056203:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448534.112491:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926946048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448534.112602:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448534.114390:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926946048 00000100:00100000:1.0:1788448534.114409:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926946048 00000100:00100000:1.0:1788448534.114519:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448534.114533:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926946048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448534.114587:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788448534.115024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448534.116489:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926946048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1944us (3872us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448534.116506:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788448534.117048:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926946048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1788448535.081830:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448535.366966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.367055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820608 00000100:00100000:3.0:1788448535.367068:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820608 00000100:00080000:0.0:1788448535.367210:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448535.367326:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 139 00000100:00100000:3.0:1788448535.367354:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+14:11345:x1875323902820608:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448535.367383:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448535.367427:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bd2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367524:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367554:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367570:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367587:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367593:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367600:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367982:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.367992:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368000:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368007:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448535.368012:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368030:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368046:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448535.368049:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448535.368055:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368062:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368075:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368081:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368088:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368093:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448535.368095:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368101:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368109:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a829674c00) 00010000:00010000:3.0:1788448535.368111:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448535.368114:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368131:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368176:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7d3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bd2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448535.368859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448535.368867:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bd2 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.368886:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38c00, rc 0) 00000100:00100000:3.0:1788448535.369074:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+14:11345:x1875323902820608:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1734us (2120us total) trans 0 rc 301/301 00000100:00100000:3.0:1788448535.369085:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 139 00000100:00100000:1.0:1788448535.387838:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.387899:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820864 00000100:00100000:3.0:1788448535.387914:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820864 00000100:00100000:3.0:1788448535.388010:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 140 00000100:00100000:3.0:1788448535.388024:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+14:11345:x1875323902820864:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:3.0:1788448535.388106:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448535.388147:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a809246e00/0xd0e9b344b90ab151 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a0b expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.388175:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448535.388181:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448535.388548:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.388574:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 5 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.388583:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.388644:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 5 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.388662:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 5 pid: 7154 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.388681:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926946176:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448535.388822:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448535.400821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.400942:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926946176:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448535.400985:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.401174:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902820992 00000100:00100000:3.0:1788448535.401215:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902820992 00010000:00010000:3.0:1788448535.401281:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 6 pid: 7154 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.401326:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:3.0:1788448535.401337:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902820992:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448535.401357:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448535.401365:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 6 pid: 7154 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.401380:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 6 pid: 7154 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.401430:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab7a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bc4 expref: 6 pid: 7154 timeout: 495 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.401449:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:3.0:1788448535.401456:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.401468:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.401476:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788448535.401555:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448535.401719:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448535.401806:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2353:x1875323902820992:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 469us (995us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448535.401815:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00010000:00010000:1.0:1788448535.403345:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.403363:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.403403:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.403418:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.403431:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448535.408783:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788448535.408811:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408836:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408845:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408852:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448535.408857:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408866:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408891:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674000) 00010000:00010000:1.0:1788448535.408895:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448535.408900:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.408907:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38c00/0xd0e9b344b90ab7e8 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448535.408933:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e799c10 reply state 00000000a01e90fc transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448535.410047:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448535.410333:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+15:11345:x1875323902820864:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 22299us (22499us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1788448535.410347:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 140 00010000:00010000:2.0:1788448535.416697:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416732:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416755:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416761:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448535.416767:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416777:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416799:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a808bbf000) 00010000:00010000:2.0:1788448535.416803:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448535.416807:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.416813:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab7ef lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.506132:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.506208:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821120 00000100:00100000:3.0:1788448535.506221:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821120 00000100:00100000:3.0:1788448535.506297:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 141 00000100:00100000:3.0:1788448535.506310:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+14:11353:x1875323902821120:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:3.0:1788448535.506351:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448535.506383:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bd9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506473:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506500:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506516:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448535.506569:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448535.506574:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448535.506715:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506759:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38e00/0xd0e9b344b90ab7f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bd9 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506778:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bd9 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.506787:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448535.506791:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448535.506795:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39a00, rc 0) 00000100:00100000:3.0:1788448535.507144:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+15:11353:x1875323902821120:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 834us (1027us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448535.507153:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 141 00000100:00100000:3.0:1788448535.570697:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.570834:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821248 00000100:00100000:0.0:1788448535.570849:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821248 00000100:00100000:0.0:1788448535.570932:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:0.0:1788448535.570945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+15:11359:x1875323902821248:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448535.570986:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448535.571017:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab804 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510be0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571155:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571173:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571239:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571259:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571266:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571272:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571534:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571543:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571552:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448535.571588:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1788448535.571592:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448535.571618:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571647:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571654:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571662:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571669:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448535.571674:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571684:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571700:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:0.0:1788448535.571703:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448535.571709:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571715:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab80b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571743:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571750:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571757:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571769:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448535.571772:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571778:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571785:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff99a80bd82b00) 00010000:00010000:0.0:1788448535.571788:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448535.571790:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571796:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab812 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571838:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab804 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be0 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571854:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be0 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.571861:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448535.571863:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788448535.571866:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed400, rc 0) 00000100:00100000:0.0:1788448535.572014:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+16:11359:x1875323902821248:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1069us (1332us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448535.572024:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 142 00000100:00100000:3.0:1788448535.575522:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.576428:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821504 00000100:00100000:1.0:1788448535.576446:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821504 00000100:00100000:1.0:1788448535.576558:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:1.0:1788448535.576570:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+16:11359:x1875323902821504:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448535.576690:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448535.576799:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab820 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510be7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.576997:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.577018:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.577033:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.577051:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.577059:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.577067:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448535.578371:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1788448535.578697:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578716:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578742:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578804:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578813:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578821:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578828:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448535.578910:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578921:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578938:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448535.578942:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448535.578948:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.578955:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab827 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448535.578972:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c5e2761 reply state 00000000f0438e3e transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448535.578984:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788448535.579030:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab820 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.579254:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.579263:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:1.0:1788448535.579266:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448535.579269:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d800, rc 0) 00000100:00100000:1.0:1788448535.579381:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11359:x1875323902821504:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2812us (3876us total) trans 4294967417 rc 0/0 00000100:00100000:1.0:1788448535.579393:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 143 00000100:00100000:3.0:1788448535.587856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.588313:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821632 00000100:00100000:0.0:1788448535.588349:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821632 00000100:00080000:1.0:1788448535.588422:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448535.588459:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1788448535.588474:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902821632:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448535.588504:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448535.588533:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bee expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448535.588571:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1788448535.588598:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=396s v=(0 0) 00010000:00010000:0.0:1788448535.588604:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448535.588617:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.588639:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.588657:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ecc00, rc 0) 00000100:00100000:0.0:1788448535.588744:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902821632:12345-192.168.204.37@tcp:101:bash.0 Request processed in 275us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448535.588751:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00010000:00010000:2.0:1788448535.589005:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589015:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589023:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589030:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448535.589035:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589062:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589081:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a808bbf100) 00010000:00010000:2.0:1788448535.589084:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448535.589090:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.589097:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90ab82e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448535.603290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.604506:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821760 00000100:00100000:3.0:1788448535.604523:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821760 00000100:00100000:3.0:1788448535.604657:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1788448535.604680:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:11359:x1875323902821760:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448535.604708:0:12065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448535.604752:0:12065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bf5 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.604799:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.604810:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448535.604819:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448535.604825:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 7 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.604883:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.604911:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.604929:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12065:1875323926946304:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448535.605061:0:12065:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448535.611208:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:12065:1875323926946304:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448535.611270:0:12065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 7 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448535.614540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.615047:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902821888 00000100:00100000:3.0:1788448535.615062:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902821888 00010000:00010000:3.0:1788448535.615119:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 8 pid: 6680 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.615234:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00010000:00010000:0.0:1788448535.615462:0:12065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38e00, rc 0) 00000100:00100000:0.0:1788448535.615546:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:11359:x1875323902821760:12345-192.168.204.37@tcp:101:bash.0 Request processed in 10869us (12272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448535.615562:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1788448535.615829:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902821888:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448535.616425:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448535.616475:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.616499:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.616534:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d5c933d/0xd0e9b344b90ab843 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bee expref: 7 pid: 6680 timeout: 496 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.616557:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448535.616563:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448535.616574:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.616586:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.616650:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448535.616683:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875323926946432:192.168.204.37@tcp:105: 00000100:00100000:2.0:1788448535.616887:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448535.624665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.624788:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902822144 00000100:00100000:0.0:1788448535.624801:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902822144 00000100:00100000:0.0:1788448535.624886:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:0.0:1788448535.624910:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:11359:x1875323902822144:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1788448535.625426:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:11359:x1875323902822144:12345-192.168.204.37@tcp:35:bash.0 Request processed in 518us (774us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1788448535.625436:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1788448535.626153:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875323926946432:192.168.204.37@tcp:105: 00010000:00010000:2.0:1788448535.626199:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448535.626290:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902821888:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 11044us (11764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448535.626301:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:3.0:1788448535.704109:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.704228:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902822400 00000100:00100000:0.0:1788448535.704244:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902822400 00000100:00100000:3.0:1788448535.704556:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 144 00000100:00100000:3.0:1788448535.704625:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+19:11369:x1875323902822400:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448535.704666:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448535.704693:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab851 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510bfc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448535.704842:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788448535.705126:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab851 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bfc expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.705252:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448535.705256:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448535.705264:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab851 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bfc expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.705280:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39e00, rc 0) 00000100:00100000:3.0:1788448535.705359:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:11369:x1875323902822400:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 792us (1267us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1788448535.705368:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 144 00000001:00080000:3.0:1788448535.709062:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967418 is committed 00000100:00100000:3.0:1788448535.709494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.709605:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902822656 00000100:00100000:0.0:1788448535.709618:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902822656 00000100:00100000:0.0:1788448535.709699:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:0.0:1788448535.709726:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+16:11369:x1875323902822656:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448535.710146:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+17:11369:x1875323902822656:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 435us (656us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1788448535.710155:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:3.0:1788448535.788995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.789102:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902822784 00000100:00100000:0.0:1788448535.789116:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902822784 00000100:00100000:1.0:1788448535.789276:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 145 00000100:00100000:1.0:1788448535.789296:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+17:11375:x1875323902822784:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448535.789337:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448535.789366:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab85f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c03 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789533:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789553:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789568:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448535.789641:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:1.0:1788448535.789645:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448535.789673:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789706:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90ab85f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c03 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789744:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c03 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.789755:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448535.789758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448535.789762:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9de00, rc 0) 00000100:00100000:1.0:1788448535.789861:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11375:x1875323902822784:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 571us (883us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448535.789868:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 145 00000100:00100000:3.0:1788448535.800821:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.801574:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823040 00000100:00100000:0.0:1788448535.801591:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823040 00000100:00100000:0.0:1788448535.801685:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 146 00000100:00100000:0.0:1788448535.801699:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+18:11375:x1875323902823040:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448535.801740:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448535.801772:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab86d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c0a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.801961:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab874 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.801978:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.803606:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab874 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448535.803646:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788448535.803881:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab86d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c0a expref: 21 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.803906:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab874 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c0a expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.803917:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:0.0:1788448535.803921:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448535.803925:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eca00, rc 0) 00000100:00100000:0.0:1788448535.804032:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:11375:x1875323902823040:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2334us (3229us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1788448535.804043:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 146 00000100:00100000:3.0:1788448535.811658:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.811778:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823424 00000100:00100000:3.0:1788448535.811780:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.811794:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823424 00000100:00100000:1.0:1788448535.811891:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1788448535.811906:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:2352:x1875323902823424:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448535.811926:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448535.811960:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab874 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c0a expref: 20 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.811986:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:1.0:1788448535.812011:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448535.812081:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+19:2352:x1875323902823424:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 178us (438us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448535.812090:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448535.813589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823296 00000100:00100000:2.0:1788448535.813606:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823296 00000100:00100000:2.0:1788448535.813688:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:2.0:1788448535.813700:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11375:x1875323902823296:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448535.813743:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448535.813768:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab882 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c11 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.813910:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.813927:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.813939:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448535.813980:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788448535.814157:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab882 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c11 expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.816395:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c11 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.816417:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:2.0:1788448535.816420:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788448535.816425:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628600, rc 0) 00000100:00100000:2.0:1788448535.816584:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:11375:x1875323902823296:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2883us (4801us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1788448535.816596:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 147 00000100:00100000:3.0:1788448535.832760:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448535.832985:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823552 00000100:00100000:2.0:1788448535.833001:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823552 00000100:00100000:2.0:1788448535.833142:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:2.0:1788448535.833155:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2355:x1875323902823552:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:2.0:1788448535.833289:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.833318:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.833330:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448535.833347:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448535.833353:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.833425:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.833443:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 6 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448535.833463:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926946560:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448535.833597:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448535.842582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448535.842951:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823680 00000100:00100000:3.0:1788448535.842965:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823680 00002000:00100000:3.0:1788448535.843061:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99a8355d3b80 x1875323902823680/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:16/0 lens 504/0 e 0 to 0 dl 1788448546 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448535.843083:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a8355d3b80 with x1875323902823680 ext(0->12) 00010000:00010000:3.0:1788448535.843095:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 7 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.843119:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 7 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448535.843129:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a8355d3b80 00000100:00100000:3.0:1788448535.843173:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1788448535.843223:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902823680:12345-192.168.204.37@tcp:4:lfs.0 00000100:00100000:3.0:1788448535.843937:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902823680:12345-192.168.204.37@tcp:4:lfs.0 Request processed in 750us (1367us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1788448535.843948:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00002000:00100000:3.0:1788448535.843959:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff99a8355d3b80 x1875323902823680/t4294967305(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:16/0 lens 504/448 e 0 to 0 dl 1788448546 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448535.843969:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a8355d3b80 with x1875323902823680 ext(0->12) 00010000:00010000:3.0:1788448535.843982:0:6687:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.844000:0:6687:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448535.844008:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff99a8355d3b80 00000100:00100000:2.0:1788448535.847747:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926946560:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448535.847799:0:6683:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.852617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.854910:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902823808 00000100:00100000:1.0:1788448535.854932:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902823808 00010000:00010000:1.0:1788448535.855010:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448535.855076:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1788448535.855090:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902823808:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448535.855117:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:1.0:1788448535.855147:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1788448535.855151:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1788448534 00002000:00010000:1.0:1788448535.855153:0:5823:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1788448534 00002000:00010000:1.0:1788448535.855155:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1788448534 00010000:00010000:1.0:1788448535.855162:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.855250:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.855284:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ab84a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bf5 expref: 9 pid: 12065 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.855306:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448535.855329:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448535.855347:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.855358:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.855394:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448535.855482:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902823808:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 394us (2885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448535.855491:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00010000:00010000:3.0:1788448535.856672:0:6683:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856694:0:6683:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856749:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856761:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856769:0:6683:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856776:0:6683:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448535.856781:0:6683:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856817:0:6683:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856850:0:6683:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.856858:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d03ce184/0xd0e9b344b90ab897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.856976:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2355:x1875323902823552:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 23819us (24230us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448535.856988:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:3.0:1788448535.863796:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448535.864476:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824064 00000100:00100000:2.0:1788448535.864491:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824064 00000100:00100000:2.0:1788448535.864581:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:2.0:1788448535.864595:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+21:11375:x1875323902824064:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:2.0:1788448535.864685:0:5840:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c11 expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448535.865067:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:2.0:1788448535.865123:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1788448535.868298:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:2.0:1788448535.868533:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.868583:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.868593:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.868648:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448535.868670:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 25 pid: 5839 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448535.869560:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875323926946688:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448535.873053:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448535.882413:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.882766:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5840:1875323926946688:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448535.882804:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.882910:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824192 00000100:00100000:3.0:1788448535.882921:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824192 00010000:00010000:3.0:1788448535.882973:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 26 pid: 5839 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.883024:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:3.0:1788448535.883036:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+26:2353:x1875323902824192:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448535.883055:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448535.883065:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 26 pid: 5839 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883080:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 26 pid: 5839 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883128:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90ab835 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be7 expref: 26 pid: 5839 timeout: 496 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883147:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:3.0:1788448535.883152:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883163:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883172:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.883249:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448535.883282:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448535.883291:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.883325:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+25:2353:x1875323902824192:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 290us (926us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448535.883335:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000001:00080000:1.0:1788448535.883479:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788448535.883772:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:1.0:1788448535.883906:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926946816:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788448535.883986:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448535.884033:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8099f93c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448535.884050:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926946816 00000100:00100000:3.0:1788448535.884060:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926946816 00000100:00100000:3.0:1788448535.884117:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448535.884126:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926946816:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448535.884241:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926946816:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448535.884248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448535.884286:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8355d1180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926946816:0@lo:1000:mdt_rdpg00_000.0 00000100:00080000:1.0:1788448535.885070:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788448535.885401:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:3.0:1788448535.885500:0:5840:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926946944:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788448535.886502:0:5840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448535.886564:0:5840:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448535.886588:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926946944 00000100:00100000:2.0:1788448535.886600:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926946944 00000100:00100000:2.0:1788448535.886664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448535.886678:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5840:x1875323926946944:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788448535.887041:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875323926946944:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 365us (542us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788448535.887056:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788448535.889841:0:5840:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aa300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5840:1875323926946944:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:3.0:1788448535.890016:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:3.0:1788448535.890114:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890128:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890136:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890143:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448535.890149:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890157:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890177:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:3.0:1788448535.890181:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1788448535.890218:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448535.890226:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab89e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448535.890518:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1788448535.891094:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:3.0:1788448535.891113:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 396497926012ns, next at 397497922572ns, rc = 0 00000001:00080000:3.0:1788448535.891143:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:3.0:1788448535.891251:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbfa00) 00010000:00010000:3.0:1788448535.891255:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788448535.891265:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab889 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c11 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448535.891429:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace3050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:11375:x1875323902824064:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 26836us (27647us total) trans 4294967431 rc 0/0 00000100:00100000:3.0:1788448535.891441:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000020:00080000:3.0:1788448535.891449:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788448535.898363:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448535.907629:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824320 00000100:00100000:1.0:1788448535.907655:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824320 00000100:00100000:0.0:1788448535.907859:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:0.0:1788448535.907873:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+28:11375:x1875323902824320:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448535.907916:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448535.907948:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab8a5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c18 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.908048:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c18 expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.908066:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab8a5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c18 expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448535.908091:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448535.908094:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448535.908099:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec600, rc 0) 00000100:00100000:0.0:1788448535.908246:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+29:11375:x1875323902824320:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 375us (9916us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448535.908254:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 148 00000100:00100000:1.0:1788448535.915387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448535.915495:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824576 00000100:00100000:0.0:1788448535.915508:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824576 00000100:00100000:0.0:1788448535.915584:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1788448535.915599:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:11375:x1875323902824576:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448535.916892:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+30:11375:x1875323902824576:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1281us (1508us total) trans 4294967432 rc 0/0 00000100:00100000:0.0:1788448535.916908:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:1.0:1788448536.034073:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448536.035018:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824832 00000100:00100000:0.0:1788448536.035034:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824832 00000100:00100000:0.0:1788448536.035129:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 149 00000100:00100000:0.0:1788448536.035143:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+30:11385:x1875323902824832:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448536.035250:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448536.035282:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c1f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448536.035414:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1788448536.035600:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8ac lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c1f expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.035620:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:0.0:1788448536.035624:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448536.035629:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c1f expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.035648:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:0.0:1788448536.035753:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+31:11385:x1875323902824832:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 613us (1702us total) trans 4294967433 rc 301/301 00000100:00100000:0.0:1788448536.035761:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 149 00000100:00100000:2.0:1788448536.041088:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448536.042199:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902824960 00000100:00100000:0.0:1788448536.042217:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902824960 00000100:00100000:0.0:1788448536.042310:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 150 00000100:00100000:0.0:1788448536.042324:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:11385:x1875323902824960:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1788448536.042452:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.042476:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.042491:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.042533:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.042541:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.042550:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.043283:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.043301:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.043315:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448536.043396:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.043416:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.043423:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.044560:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.044577:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448536.044584:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.044615:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.044641:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448536.044644:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448536.045082:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045094:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045119:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045127:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045134:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045141:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448536.045144:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045151:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045162:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82800) 00010000:00010000:0.0:1788448536.045166:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448536.045169:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045213:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045237:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045244:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045250:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045255:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448536.045258:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045264:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045272:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448536.045274:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448536.045278:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.045283:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448536.045428:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:11385:x1875323902824960:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 3098us (4350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448536.047630:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 150 00000100:00100000:1.0:1788448536.060234:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448536.060454:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902825216 00000100:00100000:3.0:1788448536.060468:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902825216 00000100:00100000:3.0:1788448536.060556:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:3.0:1788448536.060569:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+31:11385:x1875323902825216:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448536.061117:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+32:11385:x1875323902825216:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 548us (896us total) trans 4294967434 rc 0/0 00000100:00100000:3.0:1788448536.061126:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00010000:00010000:2.0:1788448536.096781:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448536.125975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448536.126157:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902825472 00000100:00100000:0.0:1788448536.126172:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902825472 00000100:00100000:0.0:1788448536.126301:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 151 00000100:00100000:0.0:1788448536.126315:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+32:11388:x1875323902825472:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448536.126350:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448536.126382:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c26 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126510:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126527:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126542:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126562:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126570:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.126576:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127255:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127267:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127288:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448536.127301:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788448536.127893:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127907:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127915:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127922:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448536.127928:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127937:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127953:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448536.127957:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448536.127963:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127969:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90ab8d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127986:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.127992:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128009:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128013:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448536.128016:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128023:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128032:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82800) 00010000:00010000:0.0:1788448536.128034:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448536.128038:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128044:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab8dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128718:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab8cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128740:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.128749:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448536.128751:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448536.128754:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:0.0:1788448536.128979:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+34:11388:x1875323902825472:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2665us (3019us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1788448536.129013:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 151 00000100:00100000:2.0:1788448536.133099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448536.133515:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902825600 00000100:00100000:1.0:1788448536.133528:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902825600 00000100:00100000:1.0:1788448536.133616:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:1.0:1788448536.133629:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:11388:x1875323902825600:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448536.133838:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133860:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133875:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133912:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133919:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133926:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133932:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448536.133938:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.133948:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.134002:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448536.134005:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448536.134011:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.134017:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448536.134155:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:11388:x1875323902825600:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 528us (1070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448536.134164:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 152 00000100:00100000:0.0:1788448536.146657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448536.146750:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902825856 00000100:00100000:3.0:1788448536.146765:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902825856 00000100:00100000:3.0:1788448536.146858:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:3.0:1788448536.146871:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:11388:x1875323902825856:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:2.0:1788448536.150559:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+35:11388:x1875323902825856:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 3666us (3895us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1788448536.150590:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:2.0:1788448536.161311:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926947200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448536.161413:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448536.161683:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926947072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.161743:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448536.162441:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947072 00000100:00100000:0.0:1788448536.162454:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947072 00000100:00100000:0.0:1788448536.162530:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788448536.162542:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926947072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.162633:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808739850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926947072:12345-0@lo:400:kworker.0 Request processed in 91us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448536.162642:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:0.0:1788448536.162691:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926947328:0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.162733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448536.162798:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926947072:0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.162831:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947200 00000100:00100000:0.0:1788448536.162835:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947200 00000100:00100000:0.0:1788448536.162865:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947328 00000100:00100000:0.0:1788448536.162868:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947328 00000100:00100000:0.0:1788448536.162908:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448536.162918:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926947200:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788448536.164754:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448536.164805:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448536.164839:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926947328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448536.164964:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926947328:12345-0@lo:400:kworker.0 Request processed in 145us (2229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448536.164972:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788448536.167729:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926947456:0@lo:400:kworker.0 00000100:00100000:1.0:1788448536.167829:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448536.169882:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926947200:12345-0@lo:400:kworker.0 Request processed in 6943us (8447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448536.169979:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788448536.170096:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926947328:0@lo:400:kworker.0 00000100:00100000:2.0:1788448536.170449:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947456 00000100:00100000:2.0:1788448536.170460:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947456 00000100:00100000:2.0:1788448536.170545:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788448536.170557:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926947456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448536.172807:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926947456:12345-0@lo:400:kworker.0 Request processed in 2237us (4962us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448536.172826:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:2.0:1788448536.172887:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448536.172946:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926947200:0@lo:400:kworker.0 00000100:00100000:2.0:1788448536.173038:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926947584:0@lo:400:kworker.0 00000100:00100000:2.0:1788448536.173123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448536.174799:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947584 00000100:00100000:0.0:1788448536.174844:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947584 00000100:00100000:0.0:1788448536.174955:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788448536.174968:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926947584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.175086:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926947584:12345-0@lo:400:kworker.0 Request processed in 121us (1963us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448536.175095:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00080000:2.0:1788448536.175547:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448536.175599:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926947584:0@lo:400:kworker.0 00000100:00100000:1.0:1788448536.176100:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926947456:0@lo:400:kworker.0 00000100:00100000:0.0:1788448536.493471:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448536.493598:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902826112 00000100:00100000:1.0:1788448536.493615:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902826112 00000100:00100000:1.0:1788448536.493733:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:1.0:1788448536.493746:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+35:11418:x1875323902826112:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1788448536.493788:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448536.493831:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c2d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.494319:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab900 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.494340:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.494358:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab900 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448536.494373:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788448536.496368:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90ab8f9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c2d expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.496421:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab900 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c2d expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.496432:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448536.496435:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448536.496440:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c800, rc 0) 00000100:00100000:1.0:1788448536.497726:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+37:11418:x1875323902826112:12345-192.168.204.37@tcp:101:cat.0 Request processed in 3201us (3483us total) trans 4294967437 rc 0/0 00000100:00100000:1.0:1788448536.497744:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 153 00000100:00100000:2.0:1788448536.506244:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448536.506314:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902826368 00000100:00100000:1.0:1788448536.506332:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902826368 00000100:00100000:2.0:1788448536.506357:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448536.506432:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:1.0:1788448536.506450:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+37:11418:x1875323902826368:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:2.0:1788448536.506452:0:5840:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1788448536.506468:0:5840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1788448536.506865:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+38:11418:x1875323902826368:12345-192.168.204.37@tcp:35:cat.0 Request processed in 418us (632us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788448536.506888:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:0.0:1788448536.508065:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902826496 00000100:00100000:0.0:1788448536.508078:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902826496 00000100:00100000:0.0:1788448536.508147:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1788448536.508157:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804616c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+38:2352:x1875323902826496:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448536.508173:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448536.508215:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90ab900 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c2d expref: 38 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.508237:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448536.508242:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448536.508298:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804616c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+37:2352:x1875323902826496:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 142us (1945us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448536.508306:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448536.620377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448536.620505:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902826752 00000100:00100000:0.0:1788448536.620517:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902826752 00000100:00100000:0.0:1788448536.620652:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 154 00000100:00100000:0.0:1788448536.620662:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+37:11425:x1875323902826752:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:0.0:1788448536.620688:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448536.620691:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448536.620727:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90ab866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c03 expref: 37 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620759:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448536.620763:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448536.620776:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab90e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c34 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620925:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620938:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620946:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620975:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.620987:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 37 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448536.621000:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926947712:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448536.621086:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8029a8d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448536.623933:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448536.624041:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902826880 00000100:00100000:1.0:1788448536.624050:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902826880 00010000:00010000:1.0:1788448536.624085:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 38 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448536.624118:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:1.0:1788448536.624126:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+38:2352:x1875323902826880:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448536.624138:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448536.624144:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 38 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.624155:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 38 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.624175:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448536.624179:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.624211:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.624218:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448536.624235:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448536.624291:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+38:2352:x1875323902826880:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 165us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448536.624332:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00010000:00010000:0.0:1788448536.625094:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab8e4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c26 expref: 37 pid: 5838 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448536.625114:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926947712:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448536.625148:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.625157:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.625162:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448536.625180:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788448536.625368:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ab90e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 38 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.625382:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 37 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.625389:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448536.625392:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788448536.625394:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092edc00, rc 0) 00000100:00100000:0.0:1788448536.625429:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+37:11425:x1875323902826752:12345-192.168.204.37@tcp:101:dd.0 Request processed in 4770us (5065us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1788448536.625435:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 154 00000100:00100000:3.0:1788448536.634790:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448536.635864:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902827136 00000100:00100000:0.0:1788448536.635874:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902827136 00000100:00100000:0.0:1788448536.635930:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 155 00000100:00100000:0.0:1788448536.635939:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+37:11425:x1875323902827136:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:0.0:1788448536.636169:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.636322:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448536.636337:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788448536.636400:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1788448536.636426:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5d2fc1c reply state 00000000ff3d1183 transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448536.636436:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448536.636592:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+40:11425:x1875323902827136:12345-192.168.204.37@tcp:36:dd.0 Request processed in 651us (1810us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788448536.636600:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 155 00000020:00080000:0.0:1788448536.636605:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448536.638136:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638152:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638160:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638371:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448536.638378:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638387:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638406:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448536.638409:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448536.638414:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448536.638420:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ab923 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448536.672576:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926947840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448536.672659:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448536.672723:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926947840 00000100:00100000:1.0:1788448536.672731:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926947840 00000100:00100000:1.0:1788448536.672793:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448536.672804:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926947840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448536.672829:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448536.672888:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926947840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448536.672894:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448536.672955:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926947840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448537.018009:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.018826:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902827264 00000100:00100000:2.0:1788448537.018842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902827264 00000100:00100000:2.0:1788448537.018952:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 156 00000100:00100000:2.0:1788448537.018967:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+39:11439:x1875323902827264:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:2.0:1788448537.019004:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448537.019162:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab92a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c3b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019364:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019402:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019415:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019436:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019443:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.019448:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1788448537.019824:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788448537.020251:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.020511:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 40 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.020521:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.020775:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 40 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.020798:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 40 pid: 7154 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.020915:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926947968:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448537.021236:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250600 going to sleep for 11 seconds 00000100:00100000:1.0:1788448537.027545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.027800:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902827520 00000100:00100000:3.0:1788448537.027823:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902827520 00000100:00100000:3.0:1788448537.027903:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:3.0:1788448537.027937:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+41:5591:x1875323902827520:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788448537.028786:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+42:5591:x1875323902827520:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 844us (1251us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1788448537.028798:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:1.0:1788448537.032341:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.032606:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902827648 00000100:00100000:3.0:1788448537.032620:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902827648 00010000:00010000:3.0:1788448537.032676:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 42 pid: 7154 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448537.032735:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1788448537.032746:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+42:2352:x1875323902827648:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448537.032765:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448537.032772:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 42 pid: 7154 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.032787:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 42 pid: 7154 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.032825:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448537.032832:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.032845:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.032854:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.032901:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448537.032974:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+42:2352:x1875323902827648:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 230us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448537.032982:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00010000:00010000:2.0:1788448537.034889:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab915 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c34 expref: 41 pid: 7154 timeout: 497 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.034925:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926947968:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448537.034960:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.034972:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.034979:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448537.035060:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788448537.035065:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448537.035102:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035119:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035130:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035137:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035165:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035171:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448537.035176:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035225:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035245:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:2.0:1788448537.035249:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448537.035254:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035529:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab931 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035546:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035553:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035559:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035631:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448537.035635:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035656:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035667:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a804d04700) 00010000:00010000:2.0:1788448537.035670:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448537.035673:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035679:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab938 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035746:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab92a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c3b expref: 41 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035763:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c3b expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.035771:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448537.035774:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788448537.035777:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628600, rc 0) 00000100:00100000:2.0:1788448537.037849:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+40:11439:x1875323902827264:12345-192.168.204.37@tcp:101:stat.0 Request processed in 18869us (19840us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448537.037866:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 156 00010000:00010000:3.0:1788448537.120610:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448537.138091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.138259:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902827904 00000100:00100000:2.0:1788448537.138273:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902827904 00000100:00100000:2.0:1788448537.138351:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 157 00000100:00100000:2.0:1788448537.138363:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+40:11445:x1875323902827904:12345-192.168.204.37@tcp:36:truncate.0 00010000:00010000:2.0:1788448537.138467:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448537.138509:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab93f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c3b expref: 40 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.138536:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448537.138541:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448537.139345:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.139368:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.139381:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448537.139450:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:2.0:1788448537.139481:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f8145173 reply state 00000000773cbc71 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.139492:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448537.140269:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+42:11445:x1875323902827904:12345-192.168.204.37@tcp:36:truncate.0 Request processed in 1901us (2185us total) trans 4294967444 rc 0/0 00000100:00100000:2.0:1788448537.140280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 157 00000020:00080000:2.0:1788448537.140288:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448537.166938:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.166964:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.166974:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.167009:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448537.167017:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.167098:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.167127:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448537.167131:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448537.167137:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.167145:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab946 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448537.410284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448537.411289:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902828032 00000100:00100000:0.0:1788448537.411301:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902828032 00000100:00100000:0.0:1788448537.411917:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 158 00000100:00100000:0.0:1788448537.411931:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+41:11459:x1875323902828032:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:0.0:1788448537.411957:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448537.411980:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab94d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c42 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412079:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412093:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412107:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412130:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412138:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412145:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412885:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412897:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412906:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448537.412942:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1788448537.412948:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448537.412969:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412981:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412990:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.412997:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413014:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413020:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448537.413024:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413033:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413046:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448537.413049:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448537.413053:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413060:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ab954 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413073:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413079:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413085:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413090:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448537.413093:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413109:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413117:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82800) 00010000:00010000:0.0:1788448537.413120:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448537.413123:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.413129:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ab95b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.414012:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90ab94d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 43 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.414034:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 42 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448537.414041:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:0.0:1788448537.414043:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448537.414046:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092edc00, rc 0) 00000100:00100000:0.0:1788448537.414119:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+42:11459:x1875323902828032:12345-192.168.204.37@tcp:101:stat.0 Request processed in 2192us (3846us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448537.414129:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 158 00000100:00100000:0.0:1788448537.559091:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.559242:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902828288 00000100:00100000:2.0:1788448537.559251:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902828288 00000100:00100000:2.0:1788448537.559311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 159 00000100:00100000:2.0:1788448537.559321:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+42:11469:x1875323902828288:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448537.559341:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448537.559362:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab969 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c49 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448537.559458:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1788448537.559596:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab969 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c49 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.559611:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:2.0:1788448537.559629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448537.559636:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab969 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c49 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.559653:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:2.0:1788448537.559769:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+43:11469:x1875323902828288:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 449us (687us total) trans 4294967445 rc 301/301 00000100:00100000:2.0:1788448537.559777:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 159 00000100:00100000:1.0:1788448537.565888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.566046:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902828544 00000100:00100000:3.0:1788448537.566058:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902828544 00000100:00100000:3.0:1788448537.566126:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:3.0:1788448537.566139:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+43:11469:x1875323902828544:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448537.566497:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace3850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+44:11469:x1875323902828544:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 360us (618us total) trans 4294967446 rc 0/0 00000100:00100000:3.0:1788448537.566505:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:3.0:1788448537.679331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.679500:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902828800 00000100:00100000:2.0:1788448537.679510:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902828800 00000100:00100000:2.0:1788448537.679572:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 160 00000100:00100000:2.0:1788448537.679583:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+44:11476:x1875323902828800:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448537.679606:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448537.679626:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab977 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c50 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.679739:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.679753:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 45 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.679762:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.679996:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 45 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.680011:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 45 pid: 7154 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.680040:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926948096:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448537.680141:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448537.686692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448537.686785:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902828928 00000100:00100000:1.0:1788448537.686794:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902828928 00010000:00010000:1.0:1788448537.686853:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 46 pid: 7154 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448537.686891:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:1.0:1788448537.686900:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+46:2352:x1875323902828928:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448537.686913:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448537.686920:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 46 pid: 7154 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.686951:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 46 pid: 7154 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.686974:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448537.686980:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.686989:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.686996:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.687016:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448537.687080:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+46:2352:x1875323902828928:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 182us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448537.687087:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00010000:00010000:2.0:1788448537.688972:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ab962 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c42 expref: 45 pid: 7154 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.688993:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926948096:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448537.689016:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.689025:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.689030:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448537.689051:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1788448537.689862:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab977 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 46 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.689882:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 45 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.689891:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448537.689894:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1788448537.689897:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:2.0:1788448537.689966:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+45:11476:x1875323902828800:12345-192.168.204.37@tcp:101:bash.0 Request processed in 10384us (10645us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1788448537.689990:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 160 00000100:00100000:0.0:1788448537.699612:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.699717:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902829184 00000100:00100000:3.0:1788448537.699727:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902829184 00000100:00100000:3.0:1788448537.699788:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 161 00000100:00100000:3.0:1788448537.699809:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+45:11476:x1875323902829184:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:3.0:1788448537.700079:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.700097:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.700109:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448537.700213:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1788448537.700253:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d7a0e987 reply state 00000000dacdd84d transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448537.700262:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448537.700350:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+48:11476:x1875323902829184:12345-192.168.204.37@tcp:36:bash.0 Request processed in 554us (747us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788448537.700358:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 161 00000020:00080000:3.0:1788448537.700364:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788448537.704404:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704421:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704429:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704434:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.704438:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704445:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704464:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448537.704466:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.704471:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.704483:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab98c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448537.708182:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.708317:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902829312 00000100:00100000:2.0:1788448537.708328:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902829312 00000100:00100000:2.0:1788448537.708385:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 162 00000100:00100000:2.0:1788448537.708408:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:11476:x1875323902829312:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448537.708436:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448537.708457:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab993 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c57 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.708552:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.708640:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.708650:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.708883:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 48 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.708900:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 48 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.708914:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926948224:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448537.708993:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448537.729516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.729743:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902829440 00000100:00100000:3.0:1788448537.729759:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902829440 00000100:00100000:1.0:1788448537.729978:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926948224:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448537.730003:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730252:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 49 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448537.730288:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:3.0:1788448537.730300:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+49:2352:x1875323902829440:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448537.730315:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448537.730322:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 49 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730335:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 49 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730360:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90ab97e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c50 expref: 49 pid: 5837 timeout: 498 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730376:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448537.730381:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730391:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730399:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.730419:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448537.730470:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+48:2352:x1875323902829440:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 173us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448537.730490:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00010000:00010000:1.0:1788448537.731001:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.731011:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448537.731059:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788448537.731070:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448537.731095:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.731129:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90ab993 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c57 expref: 48 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.732996:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c57 expref: 47 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.733018:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448537.733022:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448537.733025:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:1.0:1788448537.733093:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:11476:x1875323902829312:12345-192.168.204.37@tcp:101:bash.0 Request processed in 24684us (24916us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448537.733102:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 162 00000100:00100000:0.0:1788448537.740613:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448537.740714:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902829696 00000100:00100000:1.0:1788448537.740724:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902829696 00000100:00100000:1.0:1788448537.740786:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448537.740808:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+47:11476:x1875323902829696:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:1.0:1788448537.741054:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+48:11476:x1875323902829696:12345-192.168.204.37@tcp:35:bash.0 Request processed in 258us (449us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1788448537.741062:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00000001:00080000:1.0:1788448537.786302:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:1.0:1788448537.786321:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:0.0:1788448537.886254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.886401:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902829952 00000100:00100000:3.0:1788448537.886411:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902829952 00000100:00100000:3.0:1788448537.886559:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:3.0:1788448537.886581:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+48:11486:x1875323902829952:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448537.886607:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448537.886637:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c5e expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448537.886785:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1788448537.887109:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9a1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c5e expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.887136:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448537.887140:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448537.887145:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c5e expref: 50 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.887159:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38400, rc 0) 00000100:00100000:3.0:1788448537.887289:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+49:11486:x1875323902829952:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 711us (1045us total) trans 4294967451 rc 301/301 00000100:00100000:3.0:1788448537.887297:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 163 00000100:00100000:0.0:1788448537.894936:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.895393:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902830080 00000100:00100000:3.0:1788448537.895403:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902830080 00000100:00100000:3.0:1788448537.895583:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:3.0:1788448537.895594:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+49:11486:x1875323902830080:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:3.0:1788448537.896159:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.896178:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.899429:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.899470:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.899496:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.899503:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900136:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900147:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900156:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448537.900241:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900253:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900273:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900280:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900286:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.900290:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900297:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900309:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448537.900312:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.900316:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900320:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9af lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900332:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900337:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900343:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900347:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.900357:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900363:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900371:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a829674100) 00010000:00010000:3.0:1788448537.900374:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.900377:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900382:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900397:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900403:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900410:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900415:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.900418:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900425:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900432:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448537.900435:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.900444:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.900449:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448537.901041:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835423b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+49:11486:x1875323902830080:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 5441us (6108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448537.901053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 164 00000100:00100000:1.0:1788448537.909260:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.909354:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902830336 00000100:00100000:3.0:1788448537.909365:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902830336 00000100:00100000:3.0:1788448537.909425:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:3.0:1788448537.909437:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+49:11486:x1875323902830336:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448537.909728:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+50:11486:x1875323902830336:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 293us (476us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788448537.909736:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1788448537.979284:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.979378:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902830592 00000100:00100000:3.0:1788448537.979387:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902830592 00000100:00100000:3.0:1788448537.979447:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:3.0:1788448537.979458:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+50:11489:x1875323902830592:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448537.979495:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448537.979518:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c65 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979596:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979611:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979645:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979661:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979669:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979687:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979978:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39c00/0xd0e9b344b90ab9d9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979987:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39c00/0xd0e9b344b90ab9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.979993:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39c00/0xd0e9b344b90ab9d9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448537.980003:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1788448537.980095:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980102:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980109:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980114:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.980124:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980132:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980144:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448537.980147:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.980151:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980157:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90ab9cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980168:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980174:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980179:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980241:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448537.980245:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980250:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980258:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a829674100) 00010000:00010000:3.0:1788448537.980260:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448537.980271:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980276:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90ab9d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980321:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90ab9c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c65 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980334:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39c00/0xd0e9b344b90ab9d9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c65 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448537.980342:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448537.980344:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448537.980346:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39c00, rc 0) 00000100:00100000:3.0:1788448537.980402:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+52:11489:x1875323902830592:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 946us (1127us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1788448537.980410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:0.0:1788448537.987062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448537.987114:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448537.987230:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902830848 00000100:00100000:2.0:1788448537.987254:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902830848 00000100:00100000:2.0:1788448537.987310:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:2.0:1788448537.987319:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:11489:x1875323902830848:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:2.0:1788448537.987393:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987411:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987423:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987466:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987472:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987479:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987485:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448537.987490:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987497:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987509:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448537.987512:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448537.987517:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448537.987533:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448537.987608:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:11489:x1875323902830848:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 289us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448537.987616:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:1.0:1788448537.989008:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902830720 00000100:00100000:1.0:1788448537.989021:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902830720 00000100:00100000:1.0:1788448537.989100:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448537.989108:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:2352:x1875323902830720:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448537.989121:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448537.989142:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39c00/0xd0e9b344b90ab9d9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c65 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448537.989159:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:1.0:1788448537.989164:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448537.989249:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:2352:x1875323902830720:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 140us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448537.989256:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:0.0:1788448537.991435:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448537.991951:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831104 00000100:00100000:3.0:1788448537.991961:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831104 00000100:00100000:3.0:1788448537.992020:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:3.0:1788448537.992030:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+51:11489:x1875323902831104:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448537.992305:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+52:11489:x1875323902831104:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 275us (877us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1788448537.992313:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1788448538.045113:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.045164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.045242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.045271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448538.045358:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831232 00000100:00100000:1.0:1788448538.045368:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831232 00000100:00100000:1.0:1788448538.045435:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 298 00000100:00100000:1.0:1788448538.045447:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902831232:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448538.045519:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808738850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902831232:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 75us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448538.045526:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 298 00000100:00100000:2.0:1788448538.046095:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831360 00000100:00100000:2.0:1788448538.046100:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831360 00000100:00100000:2.0:1788448538.046147:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831488 00000100:00100000:2.0:1788448538.046151:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831488 00000100:00100000:2.0:1788448538.046173:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:2.0:1788448538.046181:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902831360:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448538.046254:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902831360:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (1153us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448538.046261:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:2.0:1788448538.046277:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:2.0:1788448538.046283:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902831488:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448538.046308:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902831488:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448538.046314:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00080000:1.0:1788448538.047463:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448538.047470:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448538.047924:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831616 00000100:00100000:3.0:1788448538.047933:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831616 00000100:00100000:3.0:1788448538.048004:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 156 00000100:00100000:3.0:1788448538.048014:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902831616:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448538.048102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2352:x1875323902831616:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 89us (2828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448538.048109:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 156 00000100:00080000:1.0:1788448538.048294:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788448538.144873:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448538.260036:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448538.260122:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902831872 00000100:00100000:2.0:1788448538.260132:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902831872 00000100:00100000:2.0:1788448538.260210:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:2.0:1788448538.260221:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:11507:x1875323902831872:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:2.0:1788448538.260249:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448538.260285:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab9ee lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c6c expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448538.260391:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9f5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448538.260406:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448538.260418:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9f5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448538.260429:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788448538.260582:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90ab9ee lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c6c expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448538.260600:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9f5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c6c expref: 54 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448538.260609:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:2.0:1788448538.260612:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788448538.260615:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628c00, rc 0) 00000100:00100000:2.0:1788448538.260688:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+54:11507:x1875323902831872:12345-192.168.204.37@tcp:101:cat.0 Request processed in 467us (663us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1788448538.260695:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 167 00000100:00100000:2.0:1788448538.319897:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448538.321480:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832000 00000100:00100000:3.0:1788448538.321495:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832000 00000100:00100000:3.0:1788448538.321576:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:3.0:1788448538.321589:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:11508:x1875323902832000:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448538.321617:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448538.321650:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90aba03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c73 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321736:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321752:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321765:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448538.321813:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788448538.321818:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448538.321838:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321868:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90aba03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c73 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321887:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c73 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.321912:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448538.321916:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448538.321920:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38400, rc 0) 00000100:00100000:3.0:1788448538.321994:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:11508:x1875323902832000:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 408us (2108us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448538.322014:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 168 00000100:00100000:0.0:1788448538.330292:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448538.330391:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832384 00000100:00100000:1.0:1788448538.330400:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832384 00000100:00100000:1.0:1788448538.330458:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:1.0:1788448538.330468:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+55:11508:x1875323902832384:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448538.331124:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+56:11508:x1875323902832384:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 655us (840us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788448538.331147:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:1.0:1788448538.339546:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448538.339682:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832512 00000100:00100000:3.0:1788448538.339693:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832512 00000100:00100000:3.0:1788448538.339792:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448538.339803:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:11508:x1875323902832512:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:3.0:1788448538.339819:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788448538.339846:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90ab99a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c57 expref: 56 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.339869:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90ab9f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c6c expref: 55 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.339882:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ab8a5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c18 expref: 54 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.339892:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82200) 00010000:00010000:3.0:1788448538.339902:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448538.339966:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+53:11508:x1875323902832512:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 164us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448538.339972:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448538.345087:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.345221:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832640 00000100:00100000:0.0:1788448538.345231:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832640 00000100:00100000:0.0:1788448538.345300:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 169 00000100:00100000:0.0:1788448538.345311:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+53:11508:x1875323902832640:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:0.0:1788448538.345434:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.345451:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.345463:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448538.345674:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:0.0:1788448538.345769:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+53:11508:x1875323902832640:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 460us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448538.345786:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 169 00000100:00100000:2.0:1788448538.393095:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.393425:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832768 00000100:00100000:0.0:1788448538.393437:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832768 00000100:00100000:0.0:1788448538.393500:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 170 00000100:00100000:0.0:1788448538.393509:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+53:11510:x1875323902832768:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448538.393530:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448538.393551:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90aba18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c7a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393619:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393634:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393645:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393661:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393680:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393687:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393920:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393939:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.393946:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448538.393983:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788448538.393988:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448538.394006:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394018:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394024:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394030:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394035:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394041:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.394045:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394053:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394063:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448538.394066:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448538.394076:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394095:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394108:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394114:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394119:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394123:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.394126:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394132:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.394140:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82000) 00010000:00010000:0.0:1788448538.394143:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448538.394146:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.395382:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.395449:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90aba18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 55 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.395482:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.395490:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:0.0:1788448538.395492:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448538.395495:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed200, rc 0) 00000100:00100000:0.0:1788448538.395571:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+54:11510:x1875323902832768:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2061us (2484us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448538.395580:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 170 00000040:00080000:3.0:1788448538.912409:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448538.912420:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448538.912468:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788448538.912477:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448538.912600:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1abb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926948352:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448538.913126:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448538.923817:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1abb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926948352:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448538.926432:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448538.926610:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902832896 00000100:00100000:1.0:1788448538.926620:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902832896 00000100:00100000:1.0:1788448538.926690:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00100000:1.0:1788448538.926701:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+54:11521:x1875323902832896:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788448538.926735:0:5837:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788448538.926841:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+54:11521:x1875323902832896:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 142us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448538.926863:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00100000:2.0:1788448538.941962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.942069:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902833024 00000100:00100000:0.0:1788448538.942080:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902833024 00000100:00100000:0.0:1788448538.942179:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 172 00000100:00100000:0.0:1788448538.942226:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:11521:x1875323902833024:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1788448538.942301:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942319:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942350:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942367:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942375:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942396:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942423:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942430:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942436:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448538.942471:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788448538.942476:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448538.942488:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942499:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942506:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942513:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942518:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.942523:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942530:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942550:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:0.0:1788448538.942553:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448538.942559:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942566:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90aba34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942580:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942586:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942593:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942599:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.942602:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942608:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942616:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff99a80bd82100) 00010000:00010000:0.0:1788448538.942619:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448538.942622:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942627:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942672:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942679:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942685:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942690:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.942694:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942700:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942708:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:0.0:1788448538.942711:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448538.942713:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.942720:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448538.942802:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:11521:x1875323902833024:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 579us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448538.942812:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 172 00000100:00100000:1.0:1788448538.956406:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448538.957375:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902833280 00000100:00100000:0.0:1788448538.957389:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902833280 00000100:00100000:0.0:1788448538.957455:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:0.0:1788448538.957489:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+54:11521:x1875323902833280:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448538.957511:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448538.957542:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba49 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c81 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957665:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957682:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957695:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448538.957708:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1788448538.957821:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957830:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957838:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957844:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eca00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448538.957849:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957858:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957873:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:0.0:1788448538.957883:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448538.957890:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957897:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba50 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957941:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba49 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c81 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957952:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:0.0:1788448538.957955:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448538.957960:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba49 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c81 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448538.957970:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed000, rc 0) 00000100:00100000:0.0:1788448538.958045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902833280:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 561us (1646us total) trans 4294967457 rc 301/301 00000100:00100000:0.0:1788448538.958053:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 173 00000100:00100000:1.0:1788448538.966973:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448538.967135:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902833408 00000100:00100000:2.0:1788448538.967146:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902833408 00000100:00100000:2.0:1788448538.967252:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 174 00000100:00100000:2.0:1788448538.967262:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902833408:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448538.967297:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448538.967405:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902833408:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 145us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448538.967413:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 174 00000100:00100000:0.0:1788448538.976577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448538.976650:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902833664 00000100:00100000:3.0:1788448538.976670:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902833664 00000100:00100000:3.0:1788448538.976769:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:3.0:1788448538.976781:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902833664:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448538.976803:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448538.976807:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788448538.976838:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90aba0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c73 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.976859:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448538.976865:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448538.976879:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90aba5e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c88 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788448538.978481:0:5837:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1788448538.978715:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90aba65 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.978731:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90aba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.978752:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90aba65 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.978818:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90aba5e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c88 expref: 57 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.978836:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90aba65 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c88 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448538.978845:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a829674100) 00010000:00010000:3.0:1788448538.978848:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448538.978851:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39e00, rc 0) 00000100:00100000:3.0:1788448538.978935:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+56:11521:x1875323902833664:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 2155us (2368us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1788448538.978944:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:2.0:1788448538.995023:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448538.995358:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902833920 00000100:00100000:1.0:1788448538.995368:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902833920 00000100:00100000:1.0:1788448538.995424:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00100000:1.0:1788448538.995435:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:11521:x1875323902833920:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448538.995998:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448538.996028:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39e00/0xd0e9b344b90aba65 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c88 expref: 56 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996047:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a829674100) 00010000:00010000:1.0:1788448538.996058:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448538.996082:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996095:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996117:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996130:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996137:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996143:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996386:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996395:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996401:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996407:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448538.996411:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996419:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996427:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448538.996429:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448538.996433:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996444:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90aba73 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996453:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996459:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996475:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996479:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448538.996483:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996489:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996496:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x986bb92 (ffff99a808bbff00) 00010000:00010000:1.0:1788448538.996498:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448538.996501:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448538.996507:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba7a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x986bb92 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448538.996603:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902833920:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1169us (1591us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448538.996611:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00100000:3.0:1788448539.008127:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.009882:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902834048 00000100:00100000:0.0:1788448539.009897:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902834048 00000100:00100000:0.0:1788448539.009977:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 177 00000100:00100000:0.0:1788448539.009988:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+55:11521:x1875323902834048:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448539.010007:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448539.010029:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba81 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c8f expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010067:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010089:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010101:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010220:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90aba81 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 57 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010236:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 56 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.010245:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448539.010248:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448539.010251:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eca00, rc 0) 00000100:00100000:0.0:1788448539.010313:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+56:11521:x1875323902834048:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 328us (2199us total) trans 0 rc 0/0 00000100:00080000:1.0:1788448539.010677:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448539.010705:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 177 00000100:00100000:3.0:1788448539.014996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448539.015163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902834304 00000100:00100000:1.0:1788448539.015174:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902834304 00000100:00100000:1.0:1788448539.015277:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 178 00000100:00100000:1.0:1788448539.015287:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:11521:x1875323902834304:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448539.015398:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.015415:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.015428:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448539.015828:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:1.0:1788448539.015841:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 399622654361ns, next at 400622651871ns, rc = 0 00000004:00010000:1.0:1788448539.016825:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ced6cf9b reply state 000000000137b9d8 transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448539.016841:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448539.017251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+58:11521:x1875323902834304:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1962us (2262us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1788448539.017260:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 178 00010000:00010000:2.0:1788448539.026180:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026212:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026220:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026226:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448539.026231:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026238:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026256:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:2.0:1788448539.026260:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448539.026265:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.026271:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90aba8f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.029135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.029394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902834432 00000100:00100000:0.0:1788448539.029406:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902834432 00000100:00100000:0.0:1788448539.029486:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:0.0:1788448539.029498:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+57:11521:x1875323902834432:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448539.029526:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448539.029552:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c96 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.029616:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.029662:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 58 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.029685:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448539.029689:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448539.029692:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:0.0:1788448539.029750:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+58:11521:x1875323902834432:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 255us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448539.029758:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 179 00000100:00100000:3.0:1788448539.035063:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.035833:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902834560 00000100:00100000:2.0:1788448539.035845:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902834560 00000100:00100000:2.0:1788448539.035903:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:2.0:1788448539.035915:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2353:x1875323902834560:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788448539.036339:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902834560:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 424us (1286us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788448539.036348:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1788448539.041679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448539.042066:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902834816 00000100:00100000:1.0:1788448539.042077:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902834816 00000100:00100000:1.0:1788448539.042138:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:1.0:1788448539.042148:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+58:11521:x1875323902834816:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788448539.042579:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:11521:x1875323902834816:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 430us (908us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788448539.042606:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:0.0:1788448539.048823:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.049055:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835072 00000100:00100000:3.0:1788448539.049067:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835072 00000100:00100000:3.0:1788448539.049136:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:3.0:1788448539.049149:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:11521:x1875323902835072:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788448539.049304:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:11521:x1875323902835072:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 159us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448539.050058:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:2.0:1788448539.054052:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.054233:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835200 00000100:00100000:0.0:1788448539.054243:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835200 00000100:00100000:0.0:1788448539.054342:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 181 00000100:00100000:0.0:1788448539.054355:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+59:11521:x1875323902835200:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448539.054375:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448539.054395:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90aba9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510c9d expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.054504:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.054929:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.054953:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448539.055082:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448539.055103:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.055134:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90aba9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c9d expref: 61 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.055152:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c9d expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.055162:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:1.0:1788448539.055165:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448539.055168:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed000, rc 0) 00000100:00100000:1.0:1788448539.055294:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+60:11521:x1875323902835200:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 942us (1251us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.055301:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 181 00000100:00100000:0.0:1788448539.064710:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.064950:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835328 00000100:00100000:2.0:1788448539.064960:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835328 00000100:00100000:2.0:1788448539.065019:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:2.0:1788448539.065030:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902835328:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448539.065049:0:12065:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448539.065069:0:12065:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ca4 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448539.065095:0:12065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998f19, blocks: 0x1 00010000:00010000:2.0:1788448539.065114:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=399s v=(0 0) 00010000:00010000:2.0:1788448539.065119:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448539.065128:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 8 pid: 12065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.065147:0:12065:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 8 pid: 12065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.065232:0:12065:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629800, rc 0) 00000100:00100000:2.0:1788448539.065287:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902835328:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 258us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448539.065294:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1788448539.080913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448539.081476:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835584 00000100:00100000:1.0:1788448539.081488:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835584 00000100:00100000:1.0:1788448539.081550:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 182 00000100:00100000:1.0:1788448539.081563:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+60:11521:x1875323902835584:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448539.081873:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+60:11521:x1875323902835584:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 312us (971us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.081883:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 182 00000100:00100000:0.0:1788448539.086663:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.093675:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835712 00000100:00100000:2.0:1788448539.093690:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835712 00000100:00100000:2.0:1788448539.093928:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:2.0:1788448539.093941:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:11521:x1875323902835712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448539.093962:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448539.093987:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cab expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.094024:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 9 pid: 12065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.094033:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448539.094037:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448539.094042:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 9 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.094078:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 9 pid: 12065 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.094092:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 9 pid: 12065 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.094117:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875323926948480:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448539.094240:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8012ed180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448539.122105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.122250:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835840 00000100:00100000:0.0:1788448539.122261:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835840 00010000:00010000:0.0:1788448539.122304:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 10 pid: 12065 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.122341:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:0.0:1788448539.122350:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a804615c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+10:2352:x1875323902835840:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448539.122823:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448539.122850:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 10 pid: 12065 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.122866:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 10 pid: 12065 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.122893:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448539.122898:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448539.122907:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.122918:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.122973:0:6696:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 10 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.122989:0:6696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6696:1875323926948608:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448539.123074:0:6696:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83d4fb000 going to sleep for 11 seconds 00010000:00010000:2.0:1788448539.125051:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f191a44d/0xd0e9b344b90abaab lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ca4 expref: 10 pid: 12065 timeout: 499 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.125084:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1ad880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6683:1875323926948480:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448539.125124:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 9 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.126106:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:2.0:1788448539.126224:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:11521:x1875323902835712:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 32283us (39579us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448539.126233:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1788448539.132548:0:6696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c4e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:6696:1875323926948608:192.168.204.37@tcp:105: 00010000:00010000:3.0:1788448539.132578:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448539.132642:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a804615c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902835840:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 10291us (10545us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448539.132663:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:2.0:1788448539.149881:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.150521:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902835968 00000100:00100000:3.0:1788448539.150531:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902835968 00002000:00100000:3.0:1788448539.150585:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99a83d1ad880 x1875323902835968/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:20/0 lens 504/0 e 0 to 0 dl 1788448550 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788448539.150597:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1ad880 with x1875323902835968 ext(0->8) 00002000:00010000:3.0:1788448539.150603:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1ad880 00000100:00100000:3.0:1788448539.150631:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:3.0:1788448539.150642:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2354:x1875323902835968:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788448539.153558:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+10:2354:x1875323902835968:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 2906us (3680us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1788448539.153594:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00002000:00100000:1.0:1788448539.153608:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff99a83d1ad880 x1875323902835968/t4294967314(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:20/0 lens 504/448 e 0 to 0 dl 1788448550 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448539.153619:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1ad880 with x1875323902835968 ext(0->8) 00002000:00010000:1.0:1788448539.153624:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1ad880 00000100:00100000:0.0:1788448539.170843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.170996:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836096 00000100:00100000:2.0:1788448539.171007:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836096 00000100:00100000:2.0:1788448539.171070:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 183 00000100:00100000:2.0:1788448539.171080:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+60:11521:x1875323902836096:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00010000:00010000:1.0:1788448539.177725:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448539.234436:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926948736:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448539.234506:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448539.234586:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926948736 00000100:00100000:1.0:1788448539.234594:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926948736 00000100:00100000:1.0:1788448539.234663:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448539.234674:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926948736:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448539.234700:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448539.234746:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926948736:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.234754:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00080000:1.0:1788448539.236126:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448539.236205:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83ce36680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926948736:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448539.239174:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+60:11521:x1875323902836096:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 68084us (68331us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448539.239325:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 183 00000001:00080000:2.0:1788448539.240784:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967457 is committed 00000001:00080000:2.0:1788448539.240819:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:2.0:1788448539.240840:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000004:00080000:2.0:1788448539.240915:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1788448539.240938:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a80923cd80 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:2.0:1788448539.240942:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a8048c4c00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a80923c780 00000020:00080000:2.0:1788448539.240945:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a8048c4100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a70469a000 00000020:00080000:2.0:1788448539.240969:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1788448539.241219:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1788448539.243087:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926948864:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1788448539.243162:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448539.243252:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448539.243259:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926948992:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788448539.243282:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448539.247176:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926948864 00000100:00100000:0.0:1788448539.247227:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926948864 00000100:00100000:0.0:1788448539.247284:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926948992 00000100:00100000:0.0:1788448539.247288:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926948992 00000100:00100000:0.0:1788448539.247324:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448539.247333:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926948864:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788448539.247532:0:12065:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788448539.247536:0:12065:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788448538 00002000:00010000:0.0:1788448539.247539:0:12065:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788448539.247541:0:12065:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788448537 -> 1788448538 00002000:00010000:0.0:1788448539.247543:0:12065:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788448539.247619:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926948864:12345-0@lo:2:osp-syn-0-0.0 Request processed in 287us (4456us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1788448539.247626:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448539.247662:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788448539.247669:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926948992:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788448539.247685:0:12065:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:0.0:1788448539.247711:0:12065:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a998f16, atime: 0x6a998f16, ctime: 0x6a998f16, blocks: 0xb 00010000:00010000:0.0:1788448539.247718:0:12065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.247745:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=399s v=(0 0) 00010000:00010000:0.0:1788448539.247750:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448539.247757:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.247774:0:12065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.247784:0:12065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.247792:0:12065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.247809:0:12065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788448539.248366:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926948992:12345-0@lo:6:osp-syn-1-0.0 Request processed in 697us (5081us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788448539.248373:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788448539.250425:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448539.250479:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:2.0:1788448539.250487:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:2.0:1788448539.250516:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99a8359b3b80 x1875323926948992/t4294967307(4294967307) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788448555 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1788448539.250530:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a8359b3b80/2, rc 0, transno 4294967307 00000100:00100000:2.0:1788448539.250535:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926948992:0@lo:6:osp-syn-1-0.0 00000004:00080000:2.0:1788448539.250550:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a7056c6a00/2, rc 0, transno 4294967315 00000100:00100000:2.0:1788448539.250555:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926948864:0@lo:2:osp-syn-0-0.0 00010000:00010000:3.0:1788448539.253960:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448539.253975:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.253990:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448539.253996:0:11159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.254008:0:11159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.254041:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.254049:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abab9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.254076:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448539.254078:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448539.254080:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448539.256051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.256682:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836224 00000100:00100000:2.0:1788448539.256693:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836224 00000100:00100000:2.0:1788448539.256816:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:2.0:1788448539.256830:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+10:2354:x1875323902836224:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000040:00080000:2.0:1788448539.283315:0:12511:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448539.283324:0:12511:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448539.283361:0:12511:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788448539.283367:0:12511:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788448539.313318:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+10:2354:x1875323902836224:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 56479us (57262us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.313332:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000001:00080000:3.0:1788448539.314825:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1788448539.314847:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:2.0:1788448539.326321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.326547:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836480 00000100:00100000:0.0:1788448539.326559:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836480 00000100:00100000:0.0:1788448539.326623:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 184 00000100:00100000:0.0:1788448539.326632:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:11521:x1875323902836480:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448539.326703:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448539.326737:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed000/0xd0e9b344b90abaa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c9d expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.326775:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448539.326781:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448539.326813:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.326826:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.326835:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448539.328812:0:5838:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1c77598 reply state 00000000e001471c transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.328831:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448539.330390:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:11521:x1875323902836480:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 3749us (5461us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1788448539.330401:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 184 00010000:00010000:2.0:1788448539.338576:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338595:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338603:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338610:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448539.338615:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338624:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338642:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:2.0:1788448539.338656:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448539.338660:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.338667:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abac0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.353084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.354384:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836608 00000100:00100000:3.0:1788448539.354395:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836608 00000100:00100000:3.0:1788448539.357499:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1788448539.357522:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902836608:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788448539.357784:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788448539.357788:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788448538 -> 1788448536 00002000:00010000:3.0:1788448539.357791:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1788448534 00002000:00010000:3.0:1788448539.357793:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788448538 -> 1788448536 00002000:00010000:3.0:1788448539.357795:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1788448539.357881:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902836608:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 353us (4795us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1788448539.357891:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:2.0:1788448539.375837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.375985:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836864 00000100:00100000:3.0:1788448539.375995:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836864 00000100:00100000:3.0:1788448539.376068:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 185 00000100:00100000:3.0:1788448539.376079:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+18:11521:x1875323902836864:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788448539.376147:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.376175:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 18 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.376203:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.376242:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 18 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.376257:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 18 pid: 7154 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.376272:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926949120:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448539.376358:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448539.379814:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a9180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926949120:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448539.379846:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.380225:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.380663:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902836992 00000100:00100000:3.0:1788448539.380673:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902836992 00010000:00010000:3.0:1788448539.380712:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 19 pid: 7154 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.380756:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1788448539.380782:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:2353:x1875323902836992:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448539.380797:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448539.380804:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 19 pid: 7154 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380816:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 19 pid: 7154 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380838:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eca00/0xd0e9b344b90aba88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c8f expref: 19 pid: 7154 timeout: 499 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380852:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:3.0:1788448539.380858:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380868:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380875:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.380898:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448539.380962:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707123800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:2353:x1875323902836992:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 180us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448539.380969:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00010000:00010000:3.0:1788448539.380993:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.381001:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382256:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382268:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382275:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382280:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448539.382285:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382293:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.382990:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:3.0:1788448539.382997:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788448539.383002:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.383009:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abac7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.383101:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+17:11521:x1875323902836864:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 7020us (7269us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788448539.383111:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 185 00000100:00100000:1.0:1788448539.402330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.410672:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902837120 00000100:00100000:0.0:1788448539.410687:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902837120 00000100:00100000:0.0:1788448539.410814:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1788448539.410825:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902837120:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788448539.410873:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.410895:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.410923:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1788448539.410928:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448539.410933:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.410971:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.410986:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 8 pid: 6683 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.411002:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926949248:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448539.411098:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a81fa62240 going to sleep for 11 seconds 00000100:00100000:0.0:1788448539.431577:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.431669:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902837248 00000100:00100000:0.0:1788448539.431678:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902837248 00010000:00010000:0.0:1788448539.431719:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 9 pid: 6683 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.431769:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1788448539.431780:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902837248:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448539.431794:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448539.431818:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 9 pid: 6683 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.431847:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 9 pid: 6683 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.431875:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448539.431880:0:5822:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448539.431886:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.431897:0:5822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.431917:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448539.431966:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902837248:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 189us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448539.431974:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00010000:00010000:1.0:1788448539.437660:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abab2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cab expref: 8 pid: 6683 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448539.437701:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1875323926949248:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448539.437729:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437742:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437748:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437857:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437868:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437877:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437885:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448539.437890:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437899:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437929:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448539.437937:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e9ca7897/0xd0e9b344b90abace lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448539.438347:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902837120:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 27521us (36023us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.438358:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1788448539.444536:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.444617:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902837504 00000100:00100000:2.0:1788448539.444629:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902837504 00000100:00100000:2.0:1788448539.444701:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 186 00000100:00100000:2.0:1788448539.444711:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+17:11521:x1875323902837504:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788448539.444815:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.444833:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.444847:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.445091:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.445103:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.445110:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.445144:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.445168:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 18 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.445281:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926949376:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448539.445373:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a540 going to sleep for 11 seconds 00000100:00100000:3.0:1788448539.449264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448539.449444:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902837632 00000100:00100000:0.0:1788448539.449454:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902837632 00010000:00010000:0.0:1788448539.449496:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448539.449545:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:0.0:1788448539.449554:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:2353:x1875323902837632:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448539.449569:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448539.449576:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.449604:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 19 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.449631:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:0.0:1788448539.449637:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.449658:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.449666:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.449686:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448539.449739:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:2353:x1875323902837632:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 186us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448539.449748:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00010000:00010000:2.0:1788448539.450162:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90aba96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c96 expref: 18 pid: 5837 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448539.450179:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926949376:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448539.450224:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.450233:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.450238:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448539.450431:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1788448539.450579:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1788448539.450624:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1788448539.450739:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926949504:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788448539.450789:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448539.450827:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809e17f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448539.451450:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926949504 00000100:00100000:1.0:1788448539.451458:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926949504 00000100:00100000:1.0:1788448539.451501:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788448539.451510:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926949504:12345-0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788448539.451593:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707122a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926949504:12345-0@lo:1000:mdt00_002.0 Request processed in 84us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448539.451601:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448539.452264:0:5839:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1788448539.452273:0:5839:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a7056c6a00, transno 4294967315 00000100:00100000:2.0:1788448539.454905:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926949504:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1788448539.455491:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1788448539.455577:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926949632:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788448539.455652:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448539.455691:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808b44f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448539.455800:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926949632 00000100:00100000:3.0:1788448539.455809:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926949632 00000100:00100000:3.0:1788448539.455874:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448539.455885:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5839:x1875323926949632:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1788448539.456075:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707122d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5839:x1875323926949632:12345-0@lo:1000:mdt00_002.0 Request processed in 191us (432us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788448539.456082:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448539.456125:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707121c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5839:1875323926949632:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788448539.456156:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456167:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456175:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456181:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448539.456216:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456225:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456240:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a80bd82100) 00010000:00010000:3.0:1788448539.456243:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448539.456248:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456254:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abadc lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456280:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456293:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456299:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456304:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448539.456307:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456313:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456321:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:3.0:1788448539.456324:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448539.456327:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456333:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90aba11 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456357:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456371:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456380:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456408:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.456428:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 21 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.456440:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926949760:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448539.456504:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448539.461555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448539.461590:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902837760 00000100:00100000:3.0:1788448539.461598:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902837760 00010000:00010000:3.0:1788448539.461636:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 22 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.461681:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:3.0:1788448539.461690:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:2352:x1875323902837760:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448539.461704:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448539.461710:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 22 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.461722:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 22 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.461746:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:3.0:1788448539.461751:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.461772:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.461799:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.461820:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448539.461869:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:2352:x1875323902837760:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 180us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448539.461876:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00010000:00010000:3.0:1788448539.462017:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90aba2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510c7a expref: 21 pid: 5839 timeout: 500 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448539.462043:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1aa300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926949760:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448539.462063:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462070:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462077:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462089:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462096:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462102:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462108:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448539.462119:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462127:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462136:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:3.0:1788448539.462139:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448539.462143:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462148:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abae3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462159:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462165:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462171:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462176:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448539.462178:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462205:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462214:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a80bd82800) 00010000:00010000:3.0:1788448539.462216:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448539.462227:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448539.462233:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abad5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448539.462508:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448539.462513:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448539.463033:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1788448539.463041:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448539.463119:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cca7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+20:11521:x1875323902837504:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 18407us (18589us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1788448539.463129:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 186 00000020:00080000:3.0:1788448539.463133:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1788448539.475162:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448539.475514:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902838016 00000100:00100000:2.0:1788448539.475538:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902838016 00000100:00100000:2.0:1788448539.475604:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:2.0:1788448539.475615:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:11521:x1875323902838016:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788448539.476600:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788448539.476717:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:2.0:1788448539.477389:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477407:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477419:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477428:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477436:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477443:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448539.477465:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788448539.477594:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace0450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:11521:x1875323902838016:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 1977us (2439us total) trans 4294967468 rc 0/0 00000100:00100000:2.0:1788448539.477603:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000020:00080000:2.0:1788448539.477609:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788448539.477780:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448539.477788:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.477796:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448539.477800:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.477807:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.477822:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff99a804d04b00) 00010000:00010000:0.0:1788448539.477834:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448539.477839:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.477845:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abaea lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448539.477865:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448539.477867:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448539.477868:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448540.196552:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448540.513010:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448540.513018:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448540.513048:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788448540.513055:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788448541.217005:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448541.285997:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926950144:0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.286073:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448541.286133:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448541.286140:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926950272:0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.286165:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448541.286232:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950144 00000100:00100000:0.0:1788448541.286239:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950144 00000100:00100000:0.0:1788448541.286292:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448541.286303:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926950144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.286350:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926950144:12345-0@lo:400:kworker.0 Request processed in 49us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448541.286357:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788448541.286379:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950272 00000100:00100000:0.0:1788448541.286382:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950272 00000100:00100000:0.0:1788448541.286411:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788448541.286418:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926950272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.286448:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926950272:12345-0@lo:400:kworker.0 Request processed in 30us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448541.286454:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788448541.286487:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448541.286492:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448541.286533:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926950272:0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.286543:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926950144:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.286850:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926949888:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.286892:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448541.286938:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926950400:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.286963:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448541.286983:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788448541.286989:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926950016:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.287010:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448541.287024:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926950528:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.287045:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448541.287142:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950400 00000100:00100000:3.0:1788448541.287149:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950400 00000100:00100000:3.0:1788448541.287228:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950016 00000100:00100000:3.0:1788448541.287232:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950016 00000100:00100000:3.0:1788448541.287250:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448541.287257:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926950400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448541.287301:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707122680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926950400:12345-0@lo:400:kworker.0 Request processed in 44us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448541.287307:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788448541.287324:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448541.287339:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926950016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448541.287366:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707123b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926950016:12345-0@lo:400:kworker.0 Request processed in 28us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448541.287371:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788448541.287390:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950528 00000100:00100000:3.0:1788448541.287394:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950528 00000100:00100000:3.0:1788448541.287420:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788448541.287427:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926950528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448541.287455:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707122300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926950528:12345-0@lo:400:kworker.0 Request processed in 29us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448541.287461:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1788448541.287681:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448541.287686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448541.287744:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926950016:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.287756:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926950528:0@lo:400:kworker.0 00000100:00100000:2.0:1788448541.287766:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926950400:0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.288088:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926949888 00000100:00100000:0.0:1788448541.288095:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926949888 00000100:00100000:0.0:1788448541.288127:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788448541.288134:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926949888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448541.288208:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926949888:12345-0@lo:400:kworker.0 Request processed in 73us (1313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448541.288215:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:0.0:1788448541.288258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cca6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926949888:0@lo:400:kworker.0 00000040:00080000:3.0:1788448541.552777:0:12563:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448541.552788:0:12563:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448541.553007:0:12563:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1788448541.553014:0:12563:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788448541.673776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448541.675586:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902838272 00000100:00100000:1.0:1788448541.675611:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902838272 00000100:00100000:1.0:1788448541.675694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 187 00000100:00100000:1.0:1788448541.675706:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+22:11539:x1875323902838272:12345-192.168.204.37@tcp:101:lfs.0 00000100:00080000:2.0:1788448541.675942:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788448541.675987:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448541.676012:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abaf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cb2 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.676137:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90abaf8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.676152:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90abaf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.676166:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90abaf8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448541.676177:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1788448541.684048:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abaf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb2 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.684088:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90abaf8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb2 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.684098:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448541.684101:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448541.684105:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d600, rc 0) 00000100:00100000:3.0:1788448541.687769:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448541.687843:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902838400 00000100:00100000:2.0:1788448541.687854:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902838400 00000100:00100000:2.0:1788448541.687921:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:2.0:1788448541.687932:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+25:11539:x1875323902838400:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:2.0:1788448541.688011:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688029:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688041:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688058:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688079:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688086:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688356:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688364:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688371:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448541.688411:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688426:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688433:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688440:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688459:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448541.688464:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688473:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688493:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:2.0:1788448541.688496:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448541.688500:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688506:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abb06 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688518:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688524:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688528:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688533:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448541.688536:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688541:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688548:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a804d04800) 00010000:00010000:2.0:1788448541.688550:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448541.688553:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688559:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abb0d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688585:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688592:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688598:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688614:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448541.688617:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688623:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688631:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a804d04b00) 00010000:00010000:2.0:1788448541.688633:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448541.688636:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.688641:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abb14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448541.688715:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+25:11539:x1875323902838400:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 784us (954us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448541.688723:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 188 00000100:00100000:1.0:1788448541.691561:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+24:11539:x1875323902838272:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 15843us (17781us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1788448541.691573:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 187 00000100:00100000:3.0:1788448541.751549:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448541.751696:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902838656 00000100:00100000:1.0:1788448541.751714:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902838656 00000100:00100000:1.0:1788448541.751787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:1.0:1788448541.751799:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+24:11542:x1875323902838656:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448541.751831:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448541.751862:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cb9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.751950:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.751968:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.751980:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.751996:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752005:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752012:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752346:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752358:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752367:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448541.752379:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1788448541.752496:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752515:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752521:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752528:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448541.752533:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752541:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752555:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448541.752558:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448541.752562:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752569:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb22 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752582:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752588:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752595:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752611:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448541.752619:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752626:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752634:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a808bbf300) 00010000:00010000:1.0:1788448541.752637:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448541.752640:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752646:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb29 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752686:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752702:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.752710:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448541.752724:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448541.752727:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d800, rc 0) 00000100:00100000:1.0:1788448541.752807:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+26:11542:x1875323902838656:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1010us (1274us total) trans 4294967470 rc 0/0 00000100:00100000:1.0:1788448541.752815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 189 00000100:00100000:3.0:1788448541.758005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448541.762977:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902838784 00000100:00100000:1.0:1788448541.762994:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902838784 00000100:00100000:1.0:1788448541.763074:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:1.0:1788448541.763087:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:11542:x1875323902838784:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448541.763172:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763209:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763223:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763253:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763260:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763268:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763274:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448541.763278:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763286:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763299:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448541.763302:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448541.763307:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.763314:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abb3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448541.763412:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8355d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:11542:x1875323902838784:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 328us (5423us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448541.763420:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 190 00000100:00100000:0.0:1788448541.771967:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448541.772641:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839040 00000100:00100000:3.0:1788448541.772659:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839040 00000100:00100000:3.0:1788448541.772876:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:3.0:1788448541.772891:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+26:11542:x1875323902839040:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448541.773263:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+27:11542:x1875323902839040:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 374us (1304us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1788448541.773273:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:0.0:1788448541.794030:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448541.794066:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448541.794168:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448541.794372:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926950656 00000100:00100000:1.0:1788448541.794389:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926950656 00000100:00100000:1.0:1788448541.794487:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788448541.794501:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875323926950656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788448541.794543:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448541.794639:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875323926950656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448541.794648:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788448541.796724:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926950656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448541.860292:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448541.860543:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839296 00000100:00100000:3.0:1788448541.860577:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839296 00000100:00100000:3.0:1788448541.860671:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 191 00000100:00100000:3.0:1788448541.860685:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83ce36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+27:11067:x1875323902839296:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:3.0:1788448541.860898:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448541.860930:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb45 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cc0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.861073:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.861092:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.861101:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.861148:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 28 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.861164:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 28 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448541.861181:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926950784:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448541.863039:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808b44f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788448541.886309:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448541.886376:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d39180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926950784:192.168.204.37@tcp:104: 00010000:00010000:3.0:1788448541.886412:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448541.886523:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839424 00000100:00100000:0.0:1788448541.886532:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839424 00010000:00010000:0.0:1788448541.886580:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 29 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448541.886630:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:0.0:1788448541.886641:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:2353:x1875323902839424:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448541.886660:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448541.886674:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 29 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886688:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 29 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886715:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abb30 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb9 expref: 29 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886733:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:0.0:1788448541.886738:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886750:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886758:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.886787:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448541.890804:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.890830:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448541.890869:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788448541.891118:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb45 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 30 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.891146:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 29 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.891157:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:3.0:1788448541.891161:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448541.891165:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38800, rc 0) 00000100:00100000:0.0:1788448541.891339:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:2353:x1875323902839424:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 4695us (5040us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448541.891354:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 72 00000100:00100000:3.0:1788448541.894245:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83ce36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:11067:x1875323902839296:12345-192.168.204.37@tcp:101:bash.0 Request processed in 33546us (33950us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788448541.894262:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 191 00000100:00100000:1.0:1788448541.903835:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448541.904849:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839680 00000100:00100000:3.0:1788448541.904864:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839680 00000100:00100000:3.0:1788448541.904939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 192 00000100:00100000:3.0:1788448541.904951:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+28:11067:x1875323902839680:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:3.0:1788448541.905341:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.905363:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448541.905383:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788448541.905450:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1788448541.905482:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9e2bd68 reply state 00000000a38f7633 transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448541.905493:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1788448541.905540:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:3.0:1788448541.905682:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+32:11067:x1875323902839680:12345-192.168.204.37@tcp:36:bash.0 Request processed in 729us (1860us total) trans 4294967475 rc 0/0 00000100:00100000:3.0:1788448541.905690:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 192 00000020:00080000:3.0:1788448541.905697:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1788448541.916382:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916410:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916429:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916437:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448541.916444:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916453:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916476:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:2.0:1788448541.916480:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448541.916486:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448541.916492:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38a00/0xd0e9b344b90abb5a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448541.917127:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448541.917304:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839808 00000100:00100000:0.0:1788448541.917318:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839808 00000100:00100000:1.0:1788448541.917557:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:1.0:1788448541.917845:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+31:11067:x1875323902839808:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448541.917885:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448541.917915:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb61 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cc7 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.918012:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc7 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.918031:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb61 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc7 expref: 32 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448541.918072:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448541.918076:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448541.918079:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9dc00, rc 0) 00000100:00100000:1.0:1788448541.918173:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+32:11067:x1875323902839808:12345-192.168.204.37@tcp:101:bash.0 Request processed in 336us (1054us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448541.918181:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 193 00000100:00100000:2.0:1788448541.936838:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448541.939414:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902839936 00000100:00100000:0.0:1788448541.939436:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902839936 00000100:00100000:0.0:1788448541.939544:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:0.0:1788448541.939557:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:11067:x1875323902839936:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448541.939581:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:2.0:1788448541.939630:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448541.939647:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cce expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788448541.939686:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a998f18, atime: 0x6a998f16, ctime: 0x6a998f18, blocks: 0xb 00010000:00010000:0.0:1788448541.939716:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=402s v=(0 0) 00010000:00010000:0.0:1788448541.939723:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448541.939734:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.939758:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448541.939775:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759200, rc 0) 00000100:00100000:0.0:1788448541.939864:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:11067:x1875323902839936:12345-192.168.204.37@tcp:101:bash.0 Request processed in 310us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448541.939872:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:2.0:1788448541.942812:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448541.943137:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840064 00000100:00100000:1.0:1788448541.943150:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840064 00002000:00010000:1.0:1788448541.943296:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788448541.943303:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a707121880 with x1875323902840064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788448541.943319:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a707121880. 00000100:00100000:1.0:1788448541.943361:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:1.0:1788448541.943374:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902840064:12345-192.168.204.37@tcp:10:bash.0 00002000:00010000:1.0:1788448541.944045:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1788448541.944052:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1788448536 -> 1788448540 00002000:00010000:1.0:1788448541.944055:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1788448534 -> 1788448534 00002000:00010000:1.0:1788448541.944058:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1788448536 -> 1788448540 00002000:00010000:1.0:1788448541.944061:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788448541.944145:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707121880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+9:2352:x1875323902840064:12345-192.168.204.37@tcp:10:bash.0 Request processed in 771us (1345us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1788448541.944155:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00002000:00010000:1.0:1788448541.944160:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:1.0:1788448541.944163:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a707121880 with x1875323902840064 ext(0->18446744073709551615) 00002000:00010000:1.0:1788448541.944169:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a707121880. 00000100:00100000:0.0:1788448542.071146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.071294:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840192 00000100:00100000:3.0:1788448542.071309:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840192 00000100:00100000:3.0:1788448542.071393:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 194 00000100:00100000:3.0:1788448542.071406:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+32:11556:x1875323902840192:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:3.0:1788448542.071660:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.071684:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.071698:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.071785:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.071794:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.071819:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073539:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073563:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073576:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448542.073672:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073689:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073696:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073705:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073711:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.073717:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073725:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073746:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448542.073763:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448542.073770:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073777:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abb6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073794:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073801:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073808:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073813:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.073816:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073822:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073830:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a829674400) 00010000:00010000:3.0:1788448542.073833:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448542.073836:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073842:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abb76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073859:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073871:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073877:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073883:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.073887:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073893:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073901:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:3.0:1788448542.073903:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448542.073906:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.073912:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abb7d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.074040:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+32:11556:x1875323902840192:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 2630us (2905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.074053:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 194 00000100:00100000:2.0:1788448542.136124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448542.138124:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840448 00000100:00100000:1.0:1788448542.138143:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840448 00000100:00100000:1.0:1788448542.138833:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:1.0:1788448542.138851:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+32:11559:x1875323902840448:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448542.138884:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448542.138917:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cd5 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139045:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139064:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139079:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139097:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139105:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139113:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139511:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abb99 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139522:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.139544:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abb99 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448542.139558:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788448542.140082:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140093:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140102:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140109:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.140115:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140124:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140141:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448542.140144:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448542.140151:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140157:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abb8b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140176:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140296:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140313:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140318:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.140322:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140329:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140338:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a808bbf300) 00010000:00010000:1.0:1788448542.140341:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448542.140344:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140349:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abb92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140413:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abb84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cd5 expref: 35 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140430:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abb99 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cd5 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.140438:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448542.140440:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448542.140442:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9de00, rc 0) 00000100:00100000:1.0:1788448542.140554:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707121f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:11559:x1875323902840448:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1708us (4445us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1788448542.140585:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 195 00000100:00100000:0.0:1788448542.144096:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448542.144175:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840576 00000100:00100000:1.0:1788448542.144232:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840576 00000100:00100000:1.0:1788448542.144303:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:1.0:1788448542.144328:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+34:11559:x1875323902840576:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448542.144427:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.144451:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.144462:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.144509:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 34 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.144525:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 34 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.144544:0:5838:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926950912:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448542.146260:0:5838:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448542.152341:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.152473:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840832 00000100:00100000:3.0:1788448542.152489:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840832 00000100:00100000:3.0:1788448542.152570:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1788448542.152585:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+35:5591:x1875323902840832:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788448542.152640:0:5838:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5838:1875323926950912:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448542.152685:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.153119:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+36:5591:x1875323902840832:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 537us (792us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1788448542.153148:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:2.0:1788448542.158120:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.158445:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902840960 00000100:00100000:3.0:1788448542.158526:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902840960 00010000:00010000:3.0:1788448542.158585:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 36 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.158646:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:3.0:1788448542.158658:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+36:2352:x1875323902840960:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448542.158678:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448542.158686:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 36 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158703:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 36 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158804:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abb4c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc0 expref: 36 pid: 5837 timeout: 502 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158824:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:3.0:1788448542.158829:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158842:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158850:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.158914:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448542.158993:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+35:2352:x1875323902840960:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 336us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.159001:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00010000:00010000:1.0:1788448542.160122:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160155:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160233:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160242:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160250:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160390:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.160397:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160406:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160422:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448542.160425:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448542.160429:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.160436:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abba7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.160543:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+34:11559:x1875323902840576:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 16224us (16457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448542.160554:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 196 00000100:00100000:2.0:1788448542.164810:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.164901:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902841216 00000100:00100000:0.0:1788448542.164917:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902841216 00000100:00100000:0.0:1788448542.165036:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:0.0:1788448542.165050:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+34:11559:x1875323902841216:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448542.165579:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707121500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+35:11559:x1875323902841216:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 527us (783us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788448542.165588:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00010000:00010000:0.0:1788448542.240797:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448542.250969:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.251049:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902841472 00000100:00100000:0.0:1788448542.251063:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902841472 00000100:00100000:1.0:1788448542.251995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 197 00000100:00100000:1.0:1788448542.252017:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+35:11570:x1875323902841472:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1788448542.252132:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448542.252162:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abbae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cdc expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252296:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252313:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252328:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252345:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252353:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252361:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252933:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abbc3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252944:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.252960:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abbc3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448542.252974:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788448542.253094:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253100:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253108:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253115:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.253171:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253180:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253291:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448542.253295:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448542.253301:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253308:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abbb5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253324:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253331:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253345:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253350:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.253353:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253360:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253369:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a808bbf300) 00010000:00010000:1.0:1788448542.253372:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448542.253375:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253381:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abbbc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253440:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abbae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cdc expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253457:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abbc3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cdc expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.253465:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:1.0:1788448542.253467:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448542.253470:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c000, rc 0) 00000100:00100000:1.0:1788448542.253578:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707121180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+37:11570:x1875323902841472:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1568us (2624us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788448542.253612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 197 00000100:00100000:0.0:1788448542.261596:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.261726:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902841728 00000100:00100000:3.0:1788448542.261740:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902841728 00000100:00100000:3.0:1788448542.261815:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:3.0:1788448542.261829:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+37:11570:x1875323902841728:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:3.0:1788448542.262155:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+38:11570:x1875323902841728:12345-192.168.204.37@tcp:35:cat.0 Request processed in 328us (594us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1788448542.262164:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:2.0:1788448542.320003:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.320182:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902841984 00000100:00100000:3.0:1788448542.320290:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902841984 00000100:00100000:3.0:1788448542.320423:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 198 00000100:00100000:3.0:1788448542.320436:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+38:11571:x1875323902841984:12345-192.168.204.37@tcp:36:rm.0 00010000:00010000:3.0:1788448542.320533:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788448542.320571:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abbc3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cdc expref: 38 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320611:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abb99 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cd5 expref: 37 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320625:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9dc00/0xd0e9b344b90abb61 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cc7 expref: 36 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320636:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a808bbf400) 00010000:00010000:3.0:1788448542.320670:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448542.320700:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320715:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320728:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320745:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320752:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.320758:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.321100:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.321351:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.321360:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448542.323909:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:3.0:1788448542.323928:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 402930741509ns, next at 403930736674ns, rc = 0 00010000:00010000:3.0:1788448542.326944:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.326995:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327009:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327020:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327026:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327089:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327305:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448542.327339:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327347:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327353:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327361:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.327367:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327375:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327403:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a829674a00) 00010000:00010000:3.0:1788448542.327406:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1788448542.327412:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327419:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abbdf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327443:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327448:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327454:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327458:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.327461:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327467:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327475:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448542.327478:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448542.327481:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.327487:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abbd1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448542.327510:0:5839:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cf126142 reply state 00000000b9ba5a09 transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.327520:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788448542.327668:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+37:11571:x1875323902841984:12345-192.168.204.37@tcp:36:rm.0 Request processed in 7228us (7677us total) trans 4294967481 rc 0/0 00000100:00100000:3.0:1788448542.327679:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 198 00010000:00010000:1.0:1788448542.327792:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448542.327802:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.327808:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448542.327812:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.327826:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.327837:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff99a829674a00) 00010000:00010000:1.0:1788448542.327839:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788448542.327841:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.327846:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38400/0xd0e9b344b90abbe6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.327862:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448542.327864:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448542.327866:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448542.331567:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331599:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331608:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331615:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448542.331621:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331630:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331654:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a829674400) 00010000:00010000:3.0:1788448542.331658:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448542.331663:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.331669:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abbd8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.404131:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.404342:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902842240 00000100:00100000:0.0:1788448542.404356:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902842240 00000100:00100000:0.0:1788448542.404437:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 199 00000100:00100000:0.0:1788448542.404451:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+36:11577:x1875323902842240:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448542.404485:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448542.404514:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abbed lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ce3 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.407999:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.408031:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.408051:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.408074:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.408082:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.408088:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448542.408855:0:7154:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1788448542.409085:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409099:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409120:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409171:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409178:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409215:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409223:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448542.409228:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409241:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409258:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448542.409262:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448542.409268:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409274:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abbf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448542.409290:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002a51706a reply state 00000000f4f74550 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448542.409300:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788448542.409350:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abbed lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 39 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409369:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 38 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.409377:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:0.0:1788448542.409379:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448542.409381:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759000, rc 0) 00000100:00100000:0.0:1788448542.409583:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+39:11577:x1875323902842240:12345-192.168.204.37@tcp:101:bash.0 Request processed in 5134us (5465us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1788448542.409606:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 199 00010000:00010000:0.0:1788448542.414017:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414041:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414050:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414056:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448542.414062:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414071:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414095:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82e00) 00010000:00010000:0.0:1788448542.414098:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448542.414135:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.414142:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abbfb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.416693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448542.416815:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902842368 00000100:00100000:2.0:1788448542.416828:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902842368 00000100:00100000:2.0:1788448542.416924:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1788448542.416938:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902842368:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448542.416973:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448542.416994:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cea expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448542.417033:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448542.417053:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=403s v=(0 0) 00010000:00010000:2.0:1788448542.417057:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448542.417067:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.417086:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 6 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.417101:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628600, rc 0) 00000100:00100000:2.0:1788448542.417167:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+6:2354:x1875323902842368:12345-192.168.204.37@tcp:101:bash.0 Request processed in 233us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448542.417175:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00080000:3.0:1788448542.417287:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448542.420808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.420880:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902842496 00000100:00100000:0.0:1788448542.420897:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902842496 00000100:00100000:0.0:1788448542.420998:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:0.0:1788448542.421011:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a809242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:11577:x1875323902842496:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448542.421035:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448542.421061:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cf1 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.421108:0:6683:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.421119:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448542.421125:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448542.421133:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.421180:0:6683:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 7 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.421276:0:6683:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 7 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448542.421329:0:6683:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926951040:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448542.421829:0:6683:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448542.425930:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.426025:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902842624 00000100:00100000:3.0:1788448542.426036:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902842624 00010000:00010000:3.0:1788448542.426083:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 8 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.426137:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:3.0:1788448542.426148:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902842624:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448542.426165:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448542.426236:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 8 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.426251:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 8 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.426277:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448542.426282:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448542.426291:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.426302:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.426347:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.426384:0:5824:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875323926951168:192.168.204.37@tcp:105: 00000100:00100000:3.0:1788448542.426460:0:5824:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a08b780 going to sleep for 11 seconds 00010000:00010000:0.0:1788448542.426848:0:6683:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0bfdcd5/0xd0e9b344b90abc10 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cea expref: 8 pid: 6680 timeout: 503 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448542.426868:0:6683:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6683:1875323926951040:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448542.426900:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 7 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.426911:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:0.0:1788448542.426945:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a809242850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:11577:x1875323902842496:12345-192.168.204.37@tcp:101:bash.0 Request processed in 5937us (6149us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448542.426954:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1788448542.437459:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448542.437700:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902842880 00000100:00100000:2.0:1788448542.437711:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902842880 00000100:00100000:2.0:1788448542.437769:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:2.0:1788448542.437779:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+38:11577:x1875323902842880:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:2.0:1788448542.438143:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+39:11577:x1875323902842880:12345-192.168.204.37@tcp:35:bash.0 Request processed in 364us (705us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788448542.438151:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1788448542.438798:0:5824:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5824:1875323926951168:192.168.204.37@tcp:105: 00010000:00010000:3.0:1788448542.438820:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448542.438848:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80486d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902842624:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 12703us (12931us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.438856:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:2.0:1788448542.644076:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448542.644511:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843008 00000100:00100000:1.0:1788448542.644526:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843008 00002000:00100000:1.0:1788448542.644616:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99a707123480 x1875323902843008/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:23/0 lens 504/0 e 0 to 0 dl 1788448553 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448542.644649:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a707123480 with x1875323902843008 ext(0->8) 00002000:00010000:1.0:1788448542.644657:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a707123480 00000100:00100000:1.0:1788448542.644709:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:1.0:1788448542.644721:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902843008:12345-192.168.204.37@tcp:4:bash.0 00000100:00100000:1.0:1788448542.645464:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707123480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902843008:12345-192.168.204.37@tcp:4:bash.0 Request processed in 739us (1400us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788448542.645476:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00002000:00100000:1.0:1788448542.645487:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff99a707123480 x1875323902843008/t4294967308(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:23/0 lens 504/448 e 0 to 0 dl 1788448553 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448542.645497:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a707123480 with x1875323902843008 ext(0->8) 00002000:00010000:1.0:1788448542.645501:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff99a707123480 00000100:00100000:1.0:1788448542.647878:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.656781:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843136 00000100:00100000:0.0:1788448542.656806:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843136 00000100:00100000:0.0:1788448542.656921:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:0.0:1788448542.656944:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902843136:12345-192.168.204.37@tcp:16:kworker.0 00000001:00080000:1.0:1788448542.835873:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1788448542.835901:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:0.0:1788448542.836148:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902843136:12345-192.168.204.37@tcp:16:kworker.0 Request processed in 179206us (188273us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448542.836163:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1788448542.846980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.848247:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843264 00000100:00100000:3.0:1788448542.848266:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843264 00000100:00100000:3.0:1788448542.848359:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 200 00000100:00100000:3.0:1788448542.848372:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+39:11593:x1875323902843264:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448542.848405:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448542.848435:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cf8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848792:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848811:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848826:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448542.848871:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1788448542.848875:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448542.848921:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848952:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf8 expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848973:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf8 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.848982:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448542.848985:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448542.848990:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38800, rc 0) 00000100:00100000:3.0:1788448542.849075:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+40:11593:x1875323902843264:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 706us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.849083:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 200 00000100:00100000:2.0:1788448542.855736:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.856308:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843520 00000100:00100000:3.0:1788448542.856323:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843520 00000100:00100000:3.0:1788448542.856403:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:3.0:1788448542.856415:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+40:11593:x1875323902843520:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448542.856453:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448542.856484:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abc2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510cff expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.856649:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abc33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.856666:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.856966:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abc33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448542.856982:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788448542.857159:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abc2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cff expref: 43 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.858418:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abc33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cff expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.858436:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:3.0:1788448542.860424:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448542.860433:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38200, rc 0) 00000100:00100000:2.0:1788448542.861293:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707123100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+42:11593:x1875323902843520:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 4869us (5562us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788448542.861307:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 201 00000100:00100000:0.0:1788448542.874259:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.874467:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843776 00000100:00100000:3.0:1788448542.874482:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843776 00000100:00100000:3.0:1788448542.874570:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1788448542.874593:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+42:2354:x1875323902843776:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448542.874617:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448542.874656:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abc33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cff expref: 42 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.874729:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:3.0:1788448542.874736:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448542.874818:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+41:2354:x1875323902843776:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 238us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.874828:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448542.879989:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.880330:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902843904 00000100:00100000:3.0:1788448542.880344:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902843904 00000100:00100000:3.0:1788448542.880423:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:3.0:1788448542.880437:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+41:11593:x1875323902843904:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448542.880472:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448542.880502:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abc41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d06 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.880658:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.880688:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.880704:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448542.880719:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788448542.880892:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abc41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d06 expref: 44 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.880916:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d06 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.880926:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:3.0:1788448542.880929:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788448542.880933:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39400, rc 0) 00000100:00100000:3.0:1788448542.881017:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+43:11593:x1875323902843904:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 581us (1043us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1788448542.881165:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 202 00000100:00100000:2.0:1788448542.906182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.906844:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844032 00000100:00100000:0.0:1788448542.906859:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844032 00000100:00100000:0.0:1788448542.906959:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:0.0:1788448542.906972:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902844032:12345-192.168.204.37@tcp:1:lfs.0 00010000:00010000:0.0:1788448542.907136:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.907166:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448542.907175:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788448542.907180:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448542.907353:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.911497:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 6 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.911533:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 6 pid: 6683 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.911555:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875323926951296:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448542.911741:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469a6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448542.927407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448542.927524:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844160 00000100:00100000:2.0:1788448542.927536:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844160 00010000:00010000:2.0:1788448542.927610:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 7 pid: 6683 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448542.927665:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 75 00000100:00100000:2.0:1788448542.927678:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902844160:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448542.927706:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788448542.927734:0:5823:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788448542.927737:0:5823:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1788448541 00002000:00010000:2.0:1788448542.927740:0:5823:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1788448541 00002000:00010000:2.0:1788448542.927742:0:5823:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1788448542.927749:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 7 pid: 6683 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.927765:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 7 pid: 6683 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.927801:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448542.927806:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448542.927814:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.927846:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.927875:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448542.927957:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902844160:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 281us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448542.927965:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 75 00010000:00010000:1.0:1788448542.933740:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009752606/0xd0e9b344b90abc17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf1 expref: 6 pid: 6683 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.933780:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6682:1875323926951296:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448542.933816:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933832:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933840:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933886:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933896:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933906:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933914:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448542.933919:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933961:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933987:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.933996:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000695a4309/0xd0e9b344b90abc56 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.934122:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902844032:12345-192.168.204.37@tcp:1:lfs.0 Request processed in 27151us (27956us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448542.934134:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:0.0:1788448542.941396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448542.941773:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844416 00000100:00100000:1.0:1788448542.941787:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844416 00000100:00100000:1.0:1788448542.941863:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:1.0:1788448542.941876:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+43:11593:x1875323902844416:12345-192.168.204.37@tcp:35:lfs.0 00000004:00010000:1.0:1788448542.941967:0:5841:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d06 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448542.942332:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:1.0:1788448542.942375:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1788448542.942801:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:1.0:1788448542.942874:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.942893:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 47 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.942924:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.942976:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 47 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.942996:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 47 pid: 7154 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.943015:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875323926951424:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448542.943133:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469a6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448542.950076:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5841:1875323926951424:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448542.950118:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448542.951175:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448542.951713:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844544 00000100:00100000:3.0:1788448542.951727:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844544 00010000:00010000:3.0:1788448542.951786:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 48 pid: 7154 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448542.951837:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:3.0:1788448542.951851:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+48:2353:x1875323902844544:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448542.951872:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448542.951881:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 48 pid: 7154 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.951894:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 48 pid: 7154 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.951922:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abc02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ce3 expref: 48 pid: 7154 timeout: 503 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.951945:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:3.0:1788448542.951951:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.951964:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.951972:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448542.952046:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448542.952130:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+47:2353:x1875323902844544:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 281us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.952140:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00010000:00010000:1.0:1788448542.952701:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.952716:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448542.952917:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:1.0:1788448542.953517:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:1.0:1788448542.953727:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926951552:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1788448542.953812:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448542.953851:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448542.954229:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926951552 00000100:00100000:3.0:1788448542.954242:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926951552 00000100:00100000:3.0:1788448542.954778:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448542.954793:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926951552:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788448542.954920:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926951552:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 130us (1107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448542.954928:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448542.959043:0:5841:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1788448542.959080:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a8359b3b80, transno 4294967307 00000100:00100000:1.0:1788448542.959109:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835afd500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926951552:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788448542.963665:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1788448542.963822:0:5841:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707120000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926951680:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788448542.963926:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448542.963982:0:5841:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807914e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448542.964179:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926951680 00000100:00100000:3.0:1788448542.964223:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926951680 00000100:00100000:3.0:1788448542.964301:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448542.964313:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875323926951680:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1788448542.964659:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707123800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875323926951680:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 347us (731us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788448542.964667:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448542.965688:0:5841:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707120000 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5841:1875323926951680:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1788448542.965824:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1788448542.965904:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965920:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965930:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965937:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448542.965943:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965952:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965973:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:1.0:1788448542.965977:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1788448542.965983:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448542.965991:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abc5d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448542.968538:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1788448542.968740:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:1.0:1788448542.968759:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 403575572758ns, next at 404575567333ns, rc = 0 00000001:00080000:1.0:1788448542.968795:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1788448542.968896:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a80bd82500) 00010000:00010000:1.0:1788448542.968901:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788448542.968915:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39400/0xd0e9b344b90abc48 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d06 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448542.969114:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace1850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+50:11593:x1875323902844416:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 27239us (27732us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1788448542.969125:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000020:00080000:1.0:1788448542.969133:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788448542.981519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448542.983320:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844672 00000100:00100000:2.0:1788448542.983341:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844672 00000100:00100000:2.0:1788448542.983452:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:2.0:1788448542.983465:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+50:11593:x1875323902844672:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448542.983500:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448542.983541:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abc64 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d0d expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.983635:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abc64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d0d expref: 51 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.983652:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abc64 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d0d expref: 51 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448542.983679:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448542.983700:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448542.983705:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628c00, rc 0) 00000100:00100000:2.0:1788448542.983793:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+51:11593:x1875323902844672:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 330us (2294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448542.983800:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 203 00000100:00100000:3.0:1788448542.989986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448542.990230:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902844928 00000100:00100000:0.0:1788448542.990245:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902844928 00000100:00100000:0.0:1788448542.990328:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1788448542.990341:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+51:11593:x1875323902844928:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448542.991849:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+52:11593:x1875323902844928:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 1497us (1864us total) trans 4294967495 rc 0/0 00000100:00100000:0.0:1788448542.991865:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:0.0:1788448543.156804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.156861:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.156898:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.156952:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.156978:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.157021:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845312 00000100:00100000:0.0:1788448543.157033:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845312 00000100:00100000:0.0:1788448543.157103:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845440 00000100:00100000:0.0:1788448543.157106:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845440 00000100:00100000:0.0:1788448543.157131:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:0.0:1788448543.157141:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:2354:x1875323902845312:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448543.157377:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:1.0:1788448543.157379:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845568 00000100:00100000:1.0:1788448543.157384:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845568 00000100:00100000:2.0:1788448543.157388:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902845440:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448543.157419:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845184 00000100:00100000:1.0:1788448543.157422:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845184 00000100:00100000:1.0:1788448543.157458:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 160 00000100:00100000:1.0:1788448543.157467:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2354:x1875323902845568:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448543.157495:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:2354:x1875323902845312:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 355us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448543.157556:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845056 00000100:00100000:3.0:1788448543.157561:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845056 00000100:00100000:3.0:1788448543.157606:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 300 00000100:00100000:3.0:1788448543.157614:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2354:x1875323902845056:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448543.157651:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:0.0:1788448543.157709:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 161 00000100:00100000:0.0:1788448543.157717:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+52:2354:x1875323902845184:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448543.170821:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2354:x1875323902845440:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 13420us (13825us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448543.170837:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00080000:2.0:1788448543.170932:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448543.170940:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448543.171102:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2354:x1875323902845568:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 13623us (14189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448543.171119:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 160 00000100:00100000:3.0:1788448543.173870:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2354:x1875323902845056:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 16244us (17068us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448543.174001:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 300 00000100:00100000:0.0:1788448543.175893:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+52:2354:x1875323902845184:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 18166us (18929us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.175906:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 161 00000100:00100000:2.0:1788448543.195298:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.195418:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845696 00000100:00100000:0.0:1788448543.195444:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845696 00000100:00100000:0.0:1788448543.195536:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 204 00000100:00100000:0.0:1788448543.195549:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:11603:x1875323902845696:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:0.0:1788448543.195680:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195715:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195730:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195772:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195780:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195787:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195910:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195919:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.195925:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448543.195984:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196002:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196008:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196017:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196024:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.196029:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196046:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196061:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448543.196065:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448543.196072:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196079:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abc6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196100:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196106:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196112:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196117:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.196120:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196126:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196133:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82700) 00010000:00010000:0.0:1788448543.196136:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448543.196138:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196154:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abc72 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196176:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196182:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196254:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196260:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.196264:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196270:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196279:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.196281:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448543.196284:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.196290:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abc79 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448543.196408:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+52:11603:x1875323902845696:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 859us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.196417:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 204 00010000:00010000:3.0:1788448543.264695:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448543.305956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448543.306088:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902845952 00000100:00100000:1.0:1788448543.306103:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902845952 00000100:00100000:1.0:1788448543.306181:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:1.0:1788448543.306236:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+52:11606:x1875323902845952:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448543.306267:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448543.306296:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abc80 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d14 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306398:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306434:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306642:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306662:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306670:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.306678:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307060:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abc95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307070:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307078:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abc95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448543.307089:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1788448543.307261:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307271:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307280:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307300:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448543.307305:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307314:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307329:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448543.307332:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448543.307338:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307345:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abc87 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307361:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307366:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307371:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307376:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448543.307378:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307383:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307399:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a808bbf300) 00010000:00010000:1.0:1788448543.307402:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448543.307405:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.307411:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abc8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.308425:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abc80 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d14 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.308469:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abc95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d14 expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.308480:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448543.308484:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448543.308487:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c800, rc 0) 00000100:00100000:1.0:1788448543.308614:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707122300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:11606:x1875323902845952:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2381us (2675us total) trans 4294967496 rc 0/0 00000100:00100000:1.0:1788448543.308625:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 205 00000100:00100000:3.0:1788448543.311776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.312108:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902846080 00000100:00100000:0.0:1788448543.312124:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902846080 00000100:00100000:0.0:1788448543.312246:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:0.0:1788448543.312259:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+54:11606:x1875323902846080:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:0.0:1788448543.312352:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312373:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312388:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312422:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312430:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312438:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312445:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.312451:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312459:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312473:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.312477:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788448543.312482:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.312511:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448543.312621:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+54:11606:x1875323902846080:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 364us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.312630:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 206 00000100:00100000:3.0:1788448543.315478:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448543.315713:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902846336 00000100:00100000:1.0:1788448543.315727:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902846336 00000100:00100000:1.0:1788448543.315796:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:1.0:1788448543.315808:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+54:11606:x1875323902846336:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448543.316125:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+55:11606:x1875323902846336:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 318us (662us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1788448543.316134:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1788448543.459166:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.459989:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902846592 00000100:00100000:0.0:1788448543.460003:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902846592 00000100:00100000:0.0:1788448543.460088:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:0.0:1788448543.460102:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+55:11616:x1875323902846592:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:0.0:1788448543.460142:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448543.460147:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788448543.460227:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38800/0xd0e9b344b90abc25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cf8 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.460254:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448543.460261:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448543.460280:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abcaa lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d1b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.460421:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcb1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.460438:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.460450:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcb1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448543.460486:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788448543.461281:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abcaa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d1b expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.461308:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcb1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d1b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.461318:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.461320:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448543.461324:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758600, rc 0) 00000100:00100000:0.0:1788448543.461422:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+56:11616:x1875323902846592:12345-192.168.204.37@tcp:101:bash.0 Request processed in 1322us (2276us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1788448543.461432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 207 00000100:00100000:0.0:1788448543.471647:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448543.471792:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902846848 00000100:00100000:2.0:1788448543.471808:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902846848 00000100:00100000:2.0:1788448543.471894:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 208 00000100:00100000:2.0:1788448543.471907:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+56:11616:x1875323902846848:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:2.0:1788448543.471996:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1788448543.472033:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcb1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d1b expref: 56 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.472065:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c800/0xd0e9b344b90abc95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d14 expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.472078:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448543.472084:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448543.472464:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.472482:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.472495:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448543.472562:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1788448543.472598:0:7154:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b75ff9d reply state 000000004b2e6e1b transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448543.472609:0:7154:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448543.473376:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+57:11616:x1875323902846848:12345-192.168.204.37@tcp:36:bash.0 Request processed in 1463us (1737us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1788448543.473387:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 208 00000020:00080000:2.0:1788448543.473395:0:7154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788448543.483264:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483291:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483299:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483305:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448543.483311:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483319:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483343:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448543.483346:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448543.483352:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.483359:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcbf lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448543.490073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448543.494985:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902846976 00000100:00100000:1.0:1788448543.495006:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902846976 00000100:00100000:1.0:1788448543.495110:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:1.0:1788448543.495123:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+56:11616:x1875323902846976:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448543.495158:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448543.495198:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abcc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d22 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495313:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495330:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495344:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448543.495627:0:5838:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1788448543.495633:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448543.495662:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495823:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abcc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495849:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448543.495860:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448543.495863:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448543.495889:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d000, rc 0) 00000100:00100000:1.0:1788448543.496040:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+57:11616:x1875323902846976:12345-192.168.204.37@tcp:101:bash.0 Request processed in 917us (5982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448543.496050:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 209 00000100:00100000:3.0:1788448543.500148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448543.500577:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902847232 00000100:00100000:1.0:1788448543.500591:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902847232 00000100:00100000:1.0:1788448543.500659:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1788448543.500670:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+57:11616:x1875323902847232:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:1.0:1788448543.500991:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+58:11616:x1875323902847232:12345-192.168.204.37@tcp:35:bash.0 Request processed in 321us (857us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1788448543.501000:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1788448543.585788:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448543.585928:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902847360 00000100:00100000:2.0:1788448543.585945:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902847360 00000100:00100000:2.0:1788448543.586040:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:2.0:1788448543.586053:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+58:11622:x1875323902847360:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448543.586091:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448543.586126:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d29 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586276:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586295:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586357:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448543.586408:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1788448543.586412:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448543.586435:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586468:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abcd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d29 expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586492:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d29 expref: 59 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.586502:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:2.0:1788448543.586505:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448543.586510:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628600, rc 0) 00000100:00100000:2.0:1788448543.586615:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902847360:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 563us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448543.586623:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 210 00000100:00100000:3.0:1788448543.597999:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.598341:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902847488 00000100:00100000:0.0:1788448543.598357:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902847488 00000100:00100000:0.0:1788448543.598444:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:0.0:1788448543.598457:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902847488:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448543.598485:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448543.598532:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abce2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d30 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598641:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598663:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598701:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598721:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598729:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598736:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598855:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598864:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598871:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448543.598915:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788448543.598920:0:5839:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448543.598942:0:5839:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598956:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598965:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598982:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598989:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.598997:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.599001:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599009:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599025:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448543.599028:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448543.599034:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599040:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abce9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599058:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599064:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599070:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599075:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448543.599084:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599090:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599098:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a80bd82700) 00010000:00010000:0.0:1788448543.599101:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448543.599104:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599110:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abcf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599150:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abce2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d30 expref: 61 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599164:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d30 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.599171:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.599174:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448543.599176:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758200, rc 0) 00000100:00100000:0.0:1788448543.599352:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+60:11622:x1875323902847488:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 897us (1369us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.599360:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 211 00000100:00100000:3.0:1788448543.601470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448543.601693:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902847616 00000100:00100000:2.0:1788448543.601707:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902847616 00000100:00100000:2.0:1788448543.601792:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1788448543.601805:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+60:2353:x1875323902847616:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448543.601824:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448543.601859:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90abcf7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d30 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.601910:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448543.601916:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448543.602008:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:2353:x1875323902847616:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 204us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448543.602017:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:3.0:1788448543.605957:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.609410:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902847872 00000100:00100000:0.0:1788448543.609435:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902847872 00000100:00100000:0.0:1788448543.609576:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:0.0:1788448543.609591:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902847872:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448543.609639:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448543.609667:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcfe lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d37 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.609806:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.609825:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.609836:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.609887:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.609905:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 60 pid: 5838 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448543.609923:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926951808:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448543.610081:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448543.613993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448543.614283:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848000 00000100:00100000:3.0:1788448543.614297:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848000 00010000:00010000:3.0:1788448543.614354:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 61 pid: 5838 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448543.614415:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:3.0:1788448543.614427:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+61:2353:x1875323902848000:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448543.614445:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448543.614453:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 61 pid: 5838 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.614471:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 61 pid: 5838 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.614501:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448543.614644:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.614657:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.614667:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448543.614692:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448543.614832:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+61:2353:x1875323902848000:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 406us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448543.614861:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00010000:00010000:0.0:1788448543.615110:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d22 expref: 60 pid: 5838 timeout: 504 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448543.615133:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926951808:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448543.615160:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.615182:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.615253:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448543.615294:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788448543.615503:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abcfe lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 61 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.615542:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 60 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.615550:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.615553:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788448543.615556:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:0.0:1788448543.615608:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+60:11622:x1875323902847872:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 6021us (9669us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788448543.615619:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 212 00000100:00100000:0.0:1788448543.627922:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448543.628084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848256 00000100:00100000:2.0:1788448543.628098:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848256 00000100:00100000:2.0:1788448543.628226:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1788448543.628239:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+60:11622:x1875323902848256:12345-192.168.204.37@tcp:103:lfs.0 00010000:00010000:2.0:1788448543.628258:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448543.628480:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abc64 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d0d expref: 60 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448543.628509:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448543.628514:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448543.628813:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902848256:12345-192.168.204.37@tcp:103:lfs.0 Request processed in 575us (907us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448543.628824:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:1.0:1788448543.642104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448543.642708:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848384 00000100:00100000:0.0:1788448543.642724:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848384 00000100:00100000:0.0:1788448543.642814:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:0.0:1788448543.642828:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902848384:12345-192.168.204.37@tcp:58:lfs.0 00010000:00010000:0.0:1788448543.642972:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.642995:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.643033:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448543.643352:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788448543.643469:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902848384:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 643us (1379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.643479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 213 00000100:00100000:1.0:1788448543.647290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448543.647667:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848512 00000100:00100000:2.0:1788448543.647682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848512 00000100:00100000:0.0:1788448543.652875:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 214 00000100:00100000:0.0:1788448543.652895:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+59:11622:x1875323902848512:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448543.652923:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448543.652950:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d3e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653033:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653046:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653069:0:5837:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653084:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653102:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448543.653106:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448543.653128:0:5837:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 60 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448543.653137:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759600, rc 0) 00000100:00100000:0.0:1788448543.653250:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+60:11622:x1875323902848512:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 360us (5993us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448543.653259:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 214 00010000:00010000:0.0:1788448544.288382:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788448544.352409:0:6880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 404959220504ns, next at 405959217513ns, rc = 0 00000100:00100000:2.0:1788448544.353353:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448544.353396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926951936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448544.353508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448544.353910:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926951936 00000100:00100000:1.0:1788448544.353923:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926951936 00000100:00100000:1.0:1788448544.354026:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448544.354037:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926951936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448544.354084:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448544.354145:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707120700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926951936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.354153:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448544.354237:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926951936:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448544.354429:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1788448544.457492:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967502 is committed 00000004:00080000:2.0:1788448544.457530:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 9 committed 00000004:00080000:2.0:1788448544.457586:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1788448544.457652:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a80469ab40 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1788448544.457658:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a839abf500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a8076496c0 00000020:00080000:2.0:1788448544.457661:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a839abfe00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a83579c800 00000020:00080000:2.0:1788448544.457684:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a8297d4540 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1788448544.457687:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a704520900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a80863bb40 00000020:00080000:2.0:1788448544.457690:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a704520e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a835bb6c00 00000020:00080000:2.0:1788448544.457705:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:2.0:1788448544.457717:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000020:00080000:2.0:1788448544.457897:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1788448544.458115:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1788448544.458314:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926952192:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788448544.458410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448544.458498:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448544.458505:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926952064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788448544.458530:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448544.458628:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926952192 00000100:00100000:1.0:1788448544.458650:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926952192 00000100:00100000:1.0:1788448544.458710:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926952064 00000100:00100000:1.0:1788448544.458713:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926952064 00000100:00100000:1.0:1788448544.458752:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788448544.458762:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926952192:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788448544.458797:0:12065:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:1.0:1788448544.458830:0:12065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.458860:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.458871:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:1.0:1788448544.458876:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448544.458881:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.458917:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 8 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.458935:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 8 pid: 6683 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.458948:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12065:1875323926952320:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448544.459019:0:12065:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469a6c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788448544.459033:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448544.459048:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788448544.459063:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926952064:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1788448544.459078:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:1.0:1788448544.459108:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a998f1d, atime: 0x0, ctime: 0x6a998f1d, blocks: 0xb 00010000:00010000:1.0:1788448544.459114:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459123:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=405s v=(0 0) 00010000:00010000:1.0:1788448544.459127:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448544.459134:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459152:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459163:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459171:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459207:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788448544.459775:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1875323926952064:12345-0@lo:6:osp-syn-1-0.0 Request processed in 710us (1240us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1788448544.459784:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00010000:1.0:1788448544.459946:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448544.459955:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459977:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448544.459983:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.459993:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.460015:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.460022:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8c65be8/0xd0e9b344b90abd28 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.460043:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448544.460045:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448544.460047:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788448544.460094:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a707121500/2, rc 0, transno 4294967310 00000100:00100000:1.0:1788448544.460100:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707121500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926952064:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1788448544.466616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.466657:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295ad500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12065:1875323926952320:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448544.466662:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848640 00000100:00100000:3.0:1788448544.466671:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848640 00010000:00010000:3.0:1788448544.466724:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 9 pid: 6683 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448544.466770:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:3.0:1788448544.466781:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80486c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902848640:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448544.466800:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448544.466807:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 9 pid: 6683 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.466823:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 9 pid: 6683 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.466855:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eadeb018/0xd0e9b344b90abb68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cce expref: 9 pid: 6683 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.466883:0:12065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.466896:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448544.467397:0:6696:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788448544.467407:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.467420:0:6696:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.482488:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448544.482622:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80486c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902848640:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 15832us (16012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448544.482638:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00010000:00010000:1.0:1788448544.482773:0:12065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.482791:0:12065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.482804:0:12065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.482824:0:12065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.482850:0:12065:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788448544.483615:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3310:x1875323926952192:12345-0@lo:6:osp-syn-0-0.0 Request processed in 24851us (25201us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1788448544.483627:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000004:00080000:1.0:1788448544.483702:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a8359d5880/2, rc 0, transno 4294967319 00000100:00100000:1.0:1788448544.483712:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926952192:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788448544.484071:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448544.484081:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.484095:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448544.484101:0:11159:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.484113:0:11159:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.484139:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.484164:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90abd21 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448544.484228:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448544.484231:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448544.484233:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448544.504701:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:1.0:1788448544.504731:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000040:00080000:0.0:1788448544.609062:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448544.609077:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448544.609179:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1788448544.609228:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448544.609400:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926952448:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448544.609570:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448544.614640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.614640:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926952448:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788448544.614941:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848768 00000100:00100000:1.0:1788448544.614951:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848768 00000100:00100000:1.0:1788448544.615025:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:1.0:1788448544.615046:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11623:x1875323902848768:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788448544.615087:0:5839:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788448544.615256:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a706c9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11623:x1875323902848768:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 219us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.615266:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 215 00000100:00100000:1.0:1788448544.623356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448544.623515:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902848896 00000100:00100000:2.0:1788448544.623538:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902848896 00000100:00100000:2.0:1788448544.623625:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:2.0:1788448544.623638:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:11623:x1875323902848896:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788448544.623740:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623763:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623780:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623803:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623811:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623837:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623867:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623876:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623883:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448544.623936:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788448544.623942:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448544.623958:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623972:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623979:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623986:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.623993:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448544.623998:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624007:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624030:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:2.0:1788448544.624047:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448544.624054:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624060:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abd2f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624079:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624086:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624092:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624097:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448544.624100:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624106:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624114:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff99a804d04000) 00010000:00010000:2.0:1788448544.624116:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448544.624119:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624125:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abd36 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624152:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624158:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624164:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624169:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448544.624172:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624178:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624252:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:2.0:1788448544.624255:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448544.624259:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.624265:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abd3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448544.624366:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:11623:x1875323902848896:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 729us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448544.624375:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 216 00000100:00100000:2.0:1788448544.629378:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.629490:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902849152 00000100:00100000:1.0:1788448544.629503:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902849152 00000100:00100000:1.0:1788448544.629604:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:1.0:1788448544.629618:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11623:x1875323902849152:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.629666:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.629695:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd44 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d45 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.629825:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.629842:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.629855:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448544.629868:0:5839:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788448544.630122:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630131:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630140:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630147:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448544.630152:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630161:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630175:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448544.630251:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788448544.630259:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630267:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd4b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630328:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd44 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d45 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630341:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:1.0:1788448544.630344:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448544.630348:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd44 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d45 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.630359:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d800, rc 0) 00000100:00100000:1.0:1788448544.630448:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849152:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 833us (1085us total) trans 4294967503 rc 301/301 00000100:00100000:1.0:1788448544.630457:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 217 00000100:00100000:2.0:1788448544.654490:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.654720:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902849280 00000100:00100000:0.0:1788448544.654735:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902849280 00000100:00100000:0.0:1788448544.654823:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:0.0:1788448544.654836:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849280:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448544.654888:0:7154:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448544.655027:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849280:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 193us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448544.655071:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 218 00000100:00100000:2.0:1788448544.660420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.661757:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902849536 00000100:00100000:1.0:1788448544.661776:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902849536 00000100:00100000:1.0:1788448544.661952:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 219 00000100:00100000:1.0:1788448544.661965:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849536:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.661993:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.661997:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1788448544.662041:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abcdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d29 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.662067:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:1.0:1788448544.662089:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448544.662108:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd59 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788448544.663973:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1788448544.665291:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.665324:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.665340:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.665431:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd59 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d4c expref: 21 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.665456:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d4c expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.665466:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf900) 00010000:00010000:1.0:1788448544.665469:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448544.665474:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c000, rc 0) 00000100:00100000:1.0:1788448544.669251:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902849536:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 7270us (8827us total) trans 4294967504 rc 0/0 00000100:00100000:1.0:1788448544.669267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 219 00000100:00100000:2.0:1788448544.678649:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.678945:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902849792 00000100:00100000:0.0:1788448544.678964:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902849792 00000100:00100000:0.0:1788448544.679056:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:0.0:1788448544.679070:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902849792:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448544.679158:0:7154:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448544.679226:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c000/0xd0e9b344b90abd60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d4c expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679251:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf900) 00010000:00010000:0.0:1788448544.679266:0:7154:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448544.679296:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679312:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679391:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679411:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679419:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679427:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679728:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679737:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679744:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679751:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448544.679756:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679766:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679776:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:0.0:1788448544.679779:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448544.679784:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679791:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abd6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679804:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679810:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679817:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679829:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448544.679833:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679840:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679849:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8784cb53 (ffff99a80bd82e00) 00010000:00010000:0.0:1788448544.679852:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448544.679855:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.679861:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759200/0xd0e9b344b90abd75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8784cb53 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448544.679977:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849792:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 907us (1338us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448544.679989:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 220 00000100:00100000:2.0:1788448544.689364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448544.689469:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902849920 00000100:00100000:3.0:1788448544.689479:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902849920 00000100:00100000:3.0:1788448544.689535:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 221 00000100:00100000:3.0:1788448544.689560:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902849920:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.689652:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.689680:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd7c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d53 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689748:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689762:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689772:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689869:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd7c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689886:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.689895:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448544.689898:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788448544.689902:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d200, rc 0) 00000100:00100000:1.0:1788448544.689969:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80868c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902849920:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 424us (691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.689977:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 221 00000100:00100000:2.0:1788448544.697586:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.698324:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902850176 00000100:00100000:1.0:1788448544.698335:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902850176 00000100:00100000:1.0:1788448544.701076:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:1.0:1788448544.701102:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902850176:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.701223:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.702982:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.702995:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448544.707265:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00010000:1.0:1788448544.707386:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d9b23579 reply state 00000000ee16ee36 transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.707400:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448544.707826:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+22:11623:x1875323902850176:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 6731us (10245us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1788448544.707836:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 222 00000100:00100000:2.0:1788448544.716471:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00010000:00010000:0.0:1788448544.717122:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717137:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717146:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717154:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448544.717159:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717224:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717242:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:0.0:1788448544.717245:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788448544.717251:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.717256:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9de00/0xd0e9b344b90abd8a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.717341:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902850304 00000100:00100000:1.0:1788448544.717351:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902850304 00000100:00100000:1.0:1788448544.717403:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 223 00000100:00100000:1.0:1788448544.717426:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:11623:x1875323902850304:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.717451:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.717470:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d5a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.717526:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.717550:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 22 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.717585:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448544.717589:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448544.717591:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d800, rc 0) 00000100:00100000:1.0:1788448544.718768:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+22:11623:x1875323902850304:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1347us (2297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.718777:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 223 00000100:00100000:2.0:1788448544.724140:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.724307:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902850432 00000100:00100000:1.0:1788448544.724317:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902850432 00000100:00100000:1.0:1788448544.724379:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:1.0:1788448544.724390:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+6:2352:x1875323902850432:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788448544.724791:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902850432:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 402us (660us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1788448544.724800:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:1.0:1788448544.729720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448544.734709:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902850688 00000100:00100000:3.0:1788448544.734724:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902850688 00000100:00100000:1.0:1788448544.735133:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1788448544.735149:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+22:11623:x1875323902850688:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788448544.735599:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902850688:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 452us (5886us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1788448544.735608:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:2.0:1788448544.747562:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.749502:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902850944 00000100:00100000:0.0:1788448544.749516:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902850944 00000100:00100000:2.0:1788448544.749924:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:2.0:1788448544.749937:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902850944:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788448544.750083:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902850944:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 149us (2541us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448544.750091:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 224 00000100:00100000:2.0:1788448544.752679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.752870:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851072 00000100:00100000:1.0:1788448544.752881:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851072 00000100:00100000:1.0:1788448544.752941:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 225 00000100:00100000:1.0:1788448544.752952:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902851072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.752990:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.753014:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abd98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d61 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753097:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753111:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753122:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448544.753158:0:5838:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448544.753176:0:5838:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753239:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d000/0xd0e9b344b90abd98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d61 expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753259:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d61 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.753268:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448544.753271:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788448544.753275:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c600, rc 0) 00000100:00100000:1.0:1788448544.753326:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+24:11623:x1875323902851072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 376us (663us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.753334:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 225 00000100:00100000:3.0:1788448544.757900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448544.758138:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851200 00000100:00100000:2.0:1788448544.758149:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851200 00000100:00100000:2.0:1788448544.758256:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:2.0:1788448544.758268:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902851200:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448544.758286:0:6683:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448544.758306:0:6683:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d68 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448544.758332:0:6683:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998f1f, blocks: 0x1 00010000:00010000:2.0:1788448544.758473:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=405s v=(0 0) 00010000:00010000:2.0:1788448544.758479:0:6683:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448544.758490:0:6683:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.758532:0:6683:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 8 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.758556:0:6683:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:2.0:1788448544.758622:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835afc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902851200:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 356us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448544.758629:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:2.0:1788448544.763589:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.763901:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851456 00000100:00100000:1.0:1788448544.763913:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851456 00000100:00100000:1.0:1788448544.763982:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 226 00000100:00100000:1.0:1788448544.763994:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+24:11623:x1875323902851456:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448544.764178:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+24:11623:x1875323902851456:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 186us (1454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.764209:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 226 00000100:00100000:2.0:1788448544.777771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.778052:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851584 00000100:00100000:1.0:1788448544.778063:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851584 00000100:00100000:1.0:1788448544.778125:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:1.0:1788448544.778135:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:11623:x1875323902851584:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.778152:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448544.778170:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d6f expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.778232:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.778242:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448544.778247:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448544.778253:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.778288:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 9 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.778321:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 9 pid: 6683 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.778350:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875323926952576:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448544.778451:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8028d2600 going to sleep for 11 seconds 00000100:00100000:0.0:1788448544.786093:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448544.788152:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851712 00000100:00100000:2.0:1788448544.788169:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851712 00010000:00010000:2.0:1788448544.788263:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 10 pid: 6683 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448544.788306:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1788448544.788316:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+10:2352:x1875323902851712:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448544.788333:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448544.788372:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 10 pid: 6683 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.788388:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 10 pid: 6683 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.788865:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448544.788888:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448544.788901:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.788913:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.788957:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448544.788973:0:5823:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875323926952704:192.168.204.37@tcp:105: 00000100:00100000:2.0:1788448544.789123:0:5823:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b480 going to sleep for 11 seconds 00010000:00010000:1.0:1788448544.789304:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a217a98f/0xd0e9b344b90abda6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d68 expref: 10 pid: 6683 timeout: 505 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.789321:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6682:1875323926952576:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448544.789843:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.789857:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d000, rc 0) 00000100:00100000:1.0:1788448544.789897:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+9:11623:x1875323902851584:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 11762us (12134us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.789906:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:2.0:1788448544.793913:0:5823:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a5880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5823:1875323926952704:192.168.204.37@tcp:105: 00010000:00010000:2.0:1788448544.793942:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448544.794004:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902851712:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 5688us (7920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448544.794015:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1788448544.796058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.796476:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851840 00000100:00100000:1.0:1788448544.796486:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851840 00002000:00100000:1.0:1788448544.796703:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99a83d1a5880 x1875323902851840/t0(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:25/0 lens 504/0 e 0 to 0 dl 1788448555 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448544.796716:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1a5880 with x1875323902851840 ext(0->12) 00002000:00010000:1.0:1788448544.796724:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1a5880 00000100:00100000:1.0:1788448544.797372:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1788448544.797407:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902851840:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788448544.798088:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:af250c24-64ec-487b-a1ec-11a62017775a+10:2352:x1875323902851840:12345-192.168.204.37@tcp:4:lhsmtool_posix.0 Request processed in 682us (2035us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788448544.798098:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00002000:00100000:1.0:1788448544.798108:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff99a83d1a5880 x1875323902851840/t4294967321(0) o4->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:25/0 lens 504/448 e 0 to 0 dl 1788448555 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788448544.798127:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1a5880 with x1875323902851840 ext(0->12) 00002000:00010000:1.0:1788448544.798132:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1a5880 00000100:00100000:0.0:1788448544.803177:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.803897:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902851968 00000100:00100000:1.0:1788448544.803910:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902851968 00000100:00100000:1.0:1788448544.803972:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 227 00000100:00100000:1.0:1788448544.803983:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+24:11623:x1875323902851968:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788448544.889133:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000100:00100000:1.0:1788448544.889481:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902851968:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 85495us (86310us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.889493:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 227 00000020:00080000:2.0:1788448544.890305:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1788448544.890420:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000020:00080000:0.0:1788448544.890435:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:2.0:1788448544.893159:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448544.893915:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852096 00000100:00100000:3.0:1788448544.894003:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852096 00000100:00100000:3.0:1788448544.894078:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1788448544.894090:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+10:2353:x1875323902852096:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1788448544.968160:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:1.0:1788448544.968218:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000100:00100000:0.0:1788448544.968407:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902852096:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 74304us (75243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448544.968419:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:3.0:1788448544.972916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.974549:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852352 00000100:00100000:1.0:1788448544.974565:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852352 00000100:00100000:1.0:1788448544.975218:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 228 00000100:00100000:1.0:1788448544.975232:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902852352:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448544.975293:0:5837:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448544.975324:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c600/0xd0e9b344b90abd9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d61 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.975375:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448544.975380:0:5837:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448544.975809:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.975824:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.975833:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448544.976558:0:5837:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009bbd3416 reply state 00000000ac54fba7 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.976572:0:5837:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448544.976710:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+21:11623:x1875323902852352:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1480us (4299us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1788448544.976719:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 228 00010000:00010000:2.0:1788448544.979577:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.979666:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.979676:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.979700:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9cc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448544.979705:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.980084:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.980103:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:2.0:1788448544.980106:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448544.980111:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448544.980117:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9cc00/0xd0e9b344b90abdb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448544.980454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448544.982570:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852480 00000100:00100000:2.0:1788448544.982584:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852480 00000100:00100000:2.0:1788448544.983173:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:2.0:1788448544.983207:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902852480:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788448544.983485:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788448544.983490:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1788448542 00002000:00010000:2.0:1788448544.983492:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1788448541 00002000:00010000:2.0:1788448544.983494:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788448543 -> 1788448542 00002000:00010000:2.0:1788448544.983497:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1788448544.983578:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902852480:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 396us (3128us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1788448544.983587:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1788448544.992101:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448544.992392:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852736 00000100:00100000:0.0:1788448544.992402:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852736 00000100:00100000:0.0:1788448544.992467:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 229 00000100:00100000:0.0:1788448544.992478:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+20:11623:x1875323902852736:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1788448544.992558:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.992575:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.992600:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.992636:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.992657:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 20 pid: 5838 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448544.992673:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707768380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926952832:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448544.992780:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757ab40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448544.996754:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707768380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5839:1875323926952832:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448544.996785:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448544.997003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448544.997089:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852864 00000100:00100000:1.0:1788448544.997097:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852864 00010000:00010000:1.0:1788448544.997135:0:5822:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 21 pid: 5838 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448544.997175:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1788448544.997236:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+21:2352:x1875323902852864:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448544.997251:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448544.997258:0:5822:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 21 pid: 5838 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997270:0:5822:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 21 pid: 5838 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997294:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d200/0xd0e9b344b90abd83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d53 expref: 21 pid: 5838 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997312:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:1.0:1788448544.997317:0:5822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997328:0:5822:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997335:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448544.997364:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448544.997413:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:2352:x1875323902852864:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 180us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448544.997422:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00010000:00010000:0.0:1788448544.997840:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.997859:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.997890:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.997897:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.997904:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.997909:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448544.997913:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.998001:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.998013:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:0.0:1788448544.998016:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788448544.998020:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448544.998026:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdbb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448544.998235:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902852736:12345-192.168.204.37@tcp:55:lhsmtool_posix.0 Request processed in 5756us (6142us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788448544.998244:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 229 00000100:00100000:3.0:1788448545.004356:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448545.004420:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902852992 00000100:00100000:1.0:1788448545.004431:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902852992 00000100:00100000:1.0:1788448545.004506:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:1.0:1788448545.004516:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902852992:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788448545.004578:0:12065:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.004605:0:12065:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.004615:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448545.004619:0:12065:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448545.004624:0:12065:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.004658:0:12065:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.004675:0:12065:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 8 pid: 6682 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448545.004692:0:12065:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8295af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12065:1875323926952960:192.168.204.37@tcp:104: 00000100:00080000:3.0:1788448545.004777:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448545.005183:0:12065:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8028d2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448545.015025:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448545.015136:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902853120 00000100:00100000:0.0:1788448545.015146:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902853120 00010000:00010000:0.0:1788448545.015243:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 9 pid: 6682 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448545.015279:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:0.0:1788448545.015290:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902853120:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448545.015305:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448545.015330:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 9 pid: 6682 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.015345:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 9 pid: 6682 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.015391:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448545.015396:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788448545.015402:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.015424:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.015447:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448545.015504:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+9:2353:x1875323902853120:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 216us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448545.015512:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00010000:00010000:1.0:1788448545.017426:0:12065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90abdad lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d6f expref: 8 pid: 6682 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448545.017451:0:12065:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8295af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:12065:1875323926952960:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448545.017476:0:12065:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017509:0:12065:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017516:0:12065:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017561:0:12065:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017951:0:12065:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017960:0:12065:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017967:0:12065:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448545.017971:0:12065:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017981:0:12065:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.017999:0:12065:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448545.018020:0:12065:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90abdc2 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 12065 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448545.018107:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902852992:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 13592us (13759us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448545.018126:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 70 00000100:00100000:3.0:1788448545.024104:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448545.024306:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902853376 00000100:00100000:2.0:1788448545.024323:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902853376 00000100:00100000:2.0:1788448545.024385:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 230 00000100:00100000:2.0:1788448545.024397:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+19:11623:x1875323902853376:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1788448545.024490:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024508:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024521:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024751:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024762:0:7154:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024772:0:7154:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024808:0:7154:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.024823:0:7154:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 20 pid: 5839 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448545.024838:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926953088:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448545.024918:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b0c0 going to sleep for 11 seconds 00000100:00080000:1.0:1788448545.025168:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448545.037027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448545.037253:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902853504 00000100:00100000:0.0:1788448545.037264:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902853504 00010000:00010000:0.0:1788448545.037307:0:6696:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 21 pid: 5839 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448545.037342:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:0.0:1788448545.037352:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+21:2352:x1875323902853504:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448545.037378:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448545.037386:0:6696:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 21 pid: 5839 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.037401:0:6696:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 21 pid: 5839 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.037439:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:0.0:1788448545.037444:0:6696:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.037453:0:6696:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.037461:0:6696:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.037645:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448545.037702:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+21:2352:x1875323902853504:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 352us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448545.037710:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00010000:00010000:2.0:1788448545.038933:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d800/0xd0e9b344b90abd91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d5a expref: 20 pid: 5839 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448545.038969:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926953088:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448545.038999:0:7154:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.039008:0:7154:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.039014:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788448545.040761:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1788448545.040968:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1788448545.042093:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:0.0:1788448545.042922:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7154:1875323926953216:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788448545.042990:0:7154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448545.043126:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448545.043558:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926953216 00000100:00100000:3.0:1788448545.043567:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926953216 00000100:00100000:3.0:1788448545.043667:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788448545.043678:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7154:x1875323926953216:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788448545.043786:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7154:x1875323926953216:12345-0@lo:1000:mdt00_003.0 Request processed in 110us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448545.043794:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448545.043867:0:7154:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967319 gen 2 00000004:00080000:0.0:1788448545.043873:0:7154:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967319 00000004:00080000:0.0:1788448545.043902:0:7154:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a8359d5880, transno 4294967319 00000100:00100000:0.0:1788448545.043925:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7154:1875323926953216:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1788448545.044450:0:7154:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1788448545.044522:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7154:1875323926953344:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788448545.044568:0:7154:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448545.045970:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448545.047407:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926953344 00000100:00100000:2.0:1788448545.047420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926953344 00000100:00100000:2.0:1788448545.047481:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788448545.047492:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7154:x1875323926953344:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788448545.048657:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7154:x1875323926953344:12345-0@lo:1000:mdt00_003.0 Request processed in 1161us (4081us total) trans 4294967323 rc 0/0 00000100:00100000:2.0:1788448545.048668:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448545.048803:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707768000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7154:1875323926953344:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1788448545.048860:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.048871:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049037:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049044:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448545.049049:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049056:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049072:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a808bbf300) 00010000:00010000:0.0:1788448545.049075:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448545.049080:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049087:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049119:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049125:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049130:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049144:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448545.049147:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049407:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049417:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448545.049419:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448545.049426:0:7154:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049436:0:7154:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049444:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.049480:0:7154:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 23 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448545.049492:0:7154:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926953472:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448545.049583:0:7154:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757a540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448545.053260:0:7154:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7154:1875323926953472:192.168.204.37@tcp:105: 00010000:00010000:0.0:1788448545.053293:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053323:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abd13 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053361:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053375:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053386:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053396:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053402:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053408:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053413:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448545.053417:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053423:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053433:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448545.053436:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448545.053439:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053454:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759000/0xd0e9b344b90abdd7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053465:0:7154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053471:0:7154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053477:0:7154:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053482:0:7154:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448545.053485:0:7154:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053491:0:7154:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053499:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448545.053501:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448545.053504:0:7154:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.053509:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abdc9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448545.054924:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448545.055076:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902853376:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 30679us (30979us total) trans 4294967512 rc 0/0 00000100:00100000:0.0:1788448545.055087:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 230 00000020:00080000:0.0:1788448545.055105:0:7154:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:2.0:1788448545.055622:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902853632 00000100:00100000:2.0:1788448545.055632:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902853632 00000100:00100000:2.0:1788448545.055694:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:2.0:1788448545.055703:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:11622:x1875323902853632:12345-192.168.204.37@tcp:49:lfs.0 00000100:00100000:2.0:1788448545.055806:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+23:11622:x1875323902853632:12345-192.168.204.37@tcp:49:lfs.0 Request processed in 104us (898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448545.055814:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000040:00080000:3.0:1788448545.058319:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448545.058328:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448545.059931:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1788448545.059947:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448545.060631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448545.060785:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902853888 00000100:00100000:3.0:1788448545.060794:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902853888 00000100:00100000:3.0:1788448545.060899:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:3.0:1788448545.060911:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80ace0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+23:11623:x1875323902853888:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788448545.061836:0:5840:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788448545.061947:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:3.0:1788448545.062000:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062019:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062032:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062042:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062062:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062068:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.062085:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788448545.062175:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80ace0850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+25:11623:x1875323902853888:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 1265us (1547us total) trans 4294967514 rc 0/0 00000100:00100000:3.0:1788448545.062210:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000020:00080000:3.0:1788448545.062217:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788448545.062325:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448545.062333:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.062341:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448545.062345:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.062353:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.062367:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff99a829674100) 00010000:00010000:0.0:1788448545.062369:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448545.062373:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.062378:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38200/0xd0e9b344b90abdde lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448545.062394:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448545.062396:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448545.062397:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448545.062442:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448545.062555:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902854144 00000100:00100000:0.0:1788448545.062562:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902854144 00000100:00100000:0.0:1788448545.062598:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 231 00000100:00100000:0.0:1788448545.062607:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+25:11622:x1875323902854144:12345-192.168.204.37@tcp:58:lfs.0 00000040:00080000:0.0:1788448545.062780:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:0.0:1788448545.062830:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+25:11622:x1875323902854144:12345-192.168.204.37@tcp:58:lfs.0 Request processed in 224us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448545.062847:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 231 00000100:00100000:0.0:1788448545.156248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448545.156526:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902854272 00000100:00100000:2.0:1788448545.156547:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902854272 00000100:00100000:2.0:1788448545.156613:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 232 00000100:00100000:2.0:1788448545.156624:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+25:11626:x1875323902854272:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448545.156663:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448545.156687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abde5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d76 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.156755:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.156769:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157031:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157051:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157058:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157065:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157377:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157389:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 26 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157404:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157436:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 26 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448545.157449:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 26 pid: 7154 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448545.157463:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926953600:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448545.157576:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80872b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448545.167022:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5837:1875323926953600:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448545.167059:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448545.167120:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448545.167224:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902854528 00000100:00100000:0.0:1788448545.167232:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902854528 00000100:00100000:0.0:1788448545.167326:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:0.0:1788448545.167339:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+27:5590:x1875323902854528:12345-192.168.204.37@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788448545.167644:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+28:5590:x1875323902854528:12345-192.168.204.37@tcp:35:ldlm_bl.0 Request processed in 307us (525us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1788448545.167661:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 63 00000100:00100000:1.0:1788448545.173237:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448545.173322:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902854656 00000100:00100000:3.0:1788448545.173332:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902854656 00010000:00010000:3.0:1788448545.173370:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 28 pid: 7154 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448545.173421:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:3.0:1788448545.173432:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+28:2355:x1875323902854656:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448545.173446:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448545.173452:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 28 pid: 7154 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173482:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 28 pid: 7154 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173504:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abd05 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d37 expref: 28 pid: 7154 timeout: 505 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173547:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448545.173553:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173564:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173571:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173600:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448545.173664:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:af250c24-64ec-487b-a1ec-11a62017775a+27:2355:x1875323902854656:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 233us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448545.173672:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00010000:00010000:3.0:1788448545.173703:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.173711:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448545.173756:0:5837:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788448545.173760:0:5837:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448545.173996:0:5837:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174010:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174020:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174037:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174043:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174050:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448545.174054:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174061:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174071:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448545.174074:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448545.174078:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174083:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abdec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174095:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174101:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174107:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174112:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448545.174121:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174128:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174136:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff99a804d04e00) 00010000:00010000:3.0:1788448545.174138:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448545.174141:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174147:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628c00/0xd0e9b344b90abdf3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174181:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810628600/0xd0e9b344b90abde5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d76 expref: 27 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174234:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d76 expref: 26 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448545.174240:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448545.174242:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448545.174245:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:3.0:1788448545.174272:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:af250c24-64ec-487b-a1ec-11a62017775a+26:11626:x1875323902854272:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 17651us (18037us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448545.174280:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 232 00010000:00010000:1.0:1788448545.313474:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448546.081665:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448546.081674:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448546.081709:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1788448546.081716:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448546.081831:0:11680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926953728:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788448546.081917:0:11680:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448546.087786:0:11680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875323926953728:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788448546.096594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448546.096965:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902854784 00000100:00100000:0.0:1788448546.096976:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902854784 00000100:00100000:0.0:1788448546.097040:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:0.0:1788448546.097051:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:11637:x1875323902854784:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788448546.097087:0:5838:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788448546.097213:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+26:11637:x1875323902854784:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 163us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448546.097221:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 233 00000100:00100000:1.0:1788448546.110675:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448546.112420:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902855040 00000100:00100000:3.0:1788448546.112433:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902855040 00000100:00100000:3.0:1788448546.112499:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 234 00000100:00100000:3.0:1788448546.112509:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+26:11637:x1875323902855040:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448546.112556:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448546.112578:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38600/0xd0e9b344b90abe01 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d7d expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448546.112688:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abe08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448546.112703:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abe08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448546.112716:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abe08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448546.112727:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1788448546.112855:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc38600/0xd0e9b344b90abe01 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d7d expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448546.112873:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abe08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d7d expref: 28 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448546.112882:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448546.112885:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448546.112888:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39600, rc 0) 00000100:00100000:3.0:1788448546.112957:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+28:11637:x1875323902855040:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 449us (2291us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788448546.112964:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 234 00000100:00100000:3.0:1788448546.122142:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448546.122286:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902855296 00000100:00100000:0.0:1788448546.122296:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902855296 00000100:00100000:0.0:1788448546.122358:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 235 00000100:00100000:0.0:1788448546.122369:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+28:11637:x1875323902855296:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788448546.122459:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122478:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122499:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122704:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122714:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122721:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122727:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448546.122732:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122740:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122753:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448546.122756:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448546.122773:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.122780:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe16 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448546.122937:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+29:11637:x1875323902855296:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 559us (794us total) trans 4294967517 rc 0/0 00000100:00100000:0.0:1788448546.122945:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 235 00000040:00080000:3.0:1788448546.123684:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448546.123690:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1788448546.123745:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000040:00080000:3.0:1788448546.124212:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1788448546.124220:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788448546.124290:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902855424 00000100:00100000:0.0:1788448546.124299:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902855424 00000100:00100000:0.0:1788448546.124353:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:0.0:1788448546.124363:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+29:2355:x1875323902855424:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448546.124386:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448546.124408:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39600/0xd0e9b344b90abe08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d7d expref: 29 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.124425:0:6696:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448546.124429:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448546.124473:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:af250c24-64ec-487b-a1ec-11a62017775a+28:2355:x1875323902855424:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 111us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448546.124489:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1788448546.133983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448546.134103:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902855680 00000100:00100000:3.0:1788448546.134115:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902855680 00000100:00100000:3.0:1788448546.134172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 64 00000100:00100000:3.0:1788448546.134211:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+28:11637:x1875323902855680:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1788448546.134953:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8359d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+29:11637:x1875323902855680:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 767us (976us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788448546.134963:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 64 00000040:00080000:2.0:1788448546.206851:0:12616:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788448546.206862:0:12616:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448546.206910:0:12616:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788448546.206916:0:12616:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788448546.311390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448546.311904:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902855936 00000100:00100000:0.0:1788448546.311914:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902855936 00000100:00100000:0.0:1788448546.311974:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 236 00000100:00100000:0.0:1788448546.311984:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+29:11650:x1875323902855936:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448546.312009:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448546.312030:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe1d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d84 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.312136:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abe24 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.312151:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abe24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.312162:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abe24 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448546.312173:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788448546.312559:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758600/0xd0e9b344b90abe1d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d84 expref: 32 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.312579:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abe24 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d84 expref: 31 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448546.312588:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:0.0:1788448546.312591:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788448546.312595:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:0.0:1788448546.312655:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:11650:x1875323902855936:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 672us (1272us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788448546.312662:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 236 00000100:00100000:0.0:1788448546.322837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448546.324398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856064 00000100:00100000:1.0:1788448546.324414:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856064 00000100:00100000:1.0:1788448546.324687:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 237 00000100:00100000:1.0:1788448546.324703:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+31:11650:x1875323902856064:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:1.0:1788448546.324776:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324794:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324814:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324840:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324847:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324853:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324858:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448546.324863:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324870:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324881:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:1.0:1788448546.324883:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448546.324888:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.324894:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9c400/0xd0e9b344b90abe32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448546.325030:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:af250c24-64ec-487b-a1ec-11a62017775a+31:11650:x1875323902856064:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 330us (2202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448546.325038:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 237 00010000:00010000:2.0:1788448546.337503:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448546.416482:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926953984:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416569:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448546.416618:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926954496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416641:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448546.416680:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1788448546.416686:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926953856:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416709:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448546.416729:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926954368:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448546.416774:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926953984 00000100:00100000:0.0:1788448546.416781:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926953984 00000100:00100000:0.0:1788448546.416818:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954368 00000100:00100000:0.0:1788448546.416821:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954368 00000100:00100000:0.0:1788448546.416846:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788448546.416855:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926953984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416900:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707121c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926953984:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448546.416906:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1788448546.416924:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788448546.416929:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926954368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.416950:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926954368:12345-0@lo:400:kworker.0 Request processed in 22us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448546.416955:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788448546.416970:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926953856 00000100:00100000:0.0:1788448546.416974:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926953856 00000100:00100000:0.0:1788448546.416993:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788448546.416998:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926953856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.417023:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926953856:12345-0@lo:400:kworker.0 Request processed in 25us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448546.417028:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1788448546.417063:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926953856:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.417083:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926954368:0@lo:400:kworker.0 00000100:00100000:0.0:1788448546.417091:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926953984:0@lo:400:kworker.0 00000100:00100000:2.0:1788448546.417634:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954496 00000100:00100000:2.0:1788448546.417641:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954496 00000100:00100000:2.0:1788448546.417681:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448546.417688:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926954496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448546.417745:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3312:x1875323926954496:12345-0@lo:400:kworker.0 Request processed in 57us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448546.417753:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1788448546.417799:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926954496:0@lo:400:kworker.0 00000100:00100000:1.0:1788448546.427894:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926954112:0@lo:400:kworker.0 00000100:00100000:1.0:1788448546.427982:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448546.428033:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448546.428040:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926954240:0@lo:400:kworker.0 00000100:00100000:1.0:1788448546.428066:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448546.428439:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954112 00000100:00100000:3.0:1788448546.428449:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954112 00000100:00100000:3.0:1788448546.428791:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1788448546.428802:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926954112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448546.428866:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926954112:12345-0@lo:400:kworker.0 Request processed in 66us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448546.428873:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00080000:1.0:1788448546.430958:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448546.430968:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448546.430991:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954240 00000100:00100000:1.0:1788448546.431000:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954240 00000100:00100000:1.0:1788448546.431059:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448546.431068:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926954240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448546.431148:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3309:x1875323926954240:12345-0@lo:400:kworker.0 Request processed in 81us (3081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448546.431155:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788448546.431226:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc13100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926954240:0@lo:400:kworker.0 00000100:00080000:0.0:1788448546.433686:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448546.433995:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc12300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926954112:0@lo:400:kworker.0 00000100:00100000:3.0:1788448546.451022:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448546.451096:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856192 00000100:00100000:1.0:1788448546.451106:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856192 00000100:00100000:1.0:1788448546.451167:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:1.0:1788448546.451178:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2352:x1875323902856192:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1788448546.451217:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448546.451248:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90abe39 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d8b expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448546.451278:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a998f1e, atime: 0x6a998f1d, ctime: 0x6a998f1e, blocks: 0xb 00010000:00010000:1.0:1788448546.451299:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=407s v=(0 0) 00010000:00010000:1.0:1788448546.451304:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448546.451471:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90abe39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d8b expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.451493:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90abe39 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d8b expref: 8 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448546.451516:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c400, rc 0) 00000100:00100000:1.0:1788448546.451577:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+8:2352:x1875323902856192:12345-192.168.204.37@tcp:101:cat.0 Request processed in 400us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448546.451584:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 71 00000100:00100000:1.0:1788448546.459488:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448546.459673:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856320 00000100:00100000:0.0:1788448546.459684:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856320 00002000:00100000:0.0:1788448546.459736:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99a83fc12300 x1875323902856320/t0(0) o3->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:27/0 lens 488/0 e 0 to 0 dl 1788448557 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448546.459747:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc12300 with x1875323902856320 ext(0->4095) 00002000:00010000:0.0:1788448546.459753:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83fc12300 00000100:00100000:0.0:1788448546.459784:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448546.459794:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902856320:12345-192.168.204.37@tcp:3:cat.0 00000100:00100000:0.0:1788448546.460000:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:af250c24-64ec-487b-a1ec-11a62017775a+8:2353:x1875323902856320:12345-192.168.204.37@tcp:3:cat.0 Request processed in 206us (520us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788448546.460008:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00002000:00100000:0.0:1788448546.460015:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff99a83fc12300 x1875323902856320/t0(0) o3->af250c24-64ec-487b-a1ec-11a62017775a@192.168.204.37@tcp:27/0 lens 488/4536 e 0 to 0 dl 1788448557 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788448546.460023:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83fc12300 with x1875323902856320 ext(0->4095) 00002000:00010000:0.0:1788448546.460025:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83fc12300 00000100:00100000:1.0:1788448546.914064:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926954624:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448546.914149:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448546.914521:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954624 00000100:00100000:3.0:1788448546.914529:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954624 00000100:00100000:3.0:1788448546.914589:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448546.914600:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926954624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448546.915018:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448546.915084:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc13100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3309:x1875323926954624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 484us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448546.915091:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788448546.915218:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926954624:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788448547.361235:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448548.028322:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:3.0:1788448548.280893:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448548.280937:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448548.280962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448548.280979:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448548.281005:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448548.281068:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856960 00000100:00100000:3.0:1788448548.281079:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856960 00000100:00100000:3.0:1788448548.281152:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856576 00000100:00100000:3.0:1788448548.281155:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856576 00000100:00100000:3.0:1788448548.281177:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:3.0:1788448548.281207:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902856960:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448548.281281:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2355:x1875323902856960:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 96us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448548.281289:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 165 00000100:00100000:3.0:1788448548.281306:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:3.0:1788448548.281312:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:2355:x1875323902856576:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448548.281338:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+31:2355:x1875323902856576:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448548.281344:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 166 00000100:00100000:2.0:1788448548.281456:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856448 00000100:00100000:2.0:1788448548.281469:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856448 00000100:00100000:2.0:1788448548.281544:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 302 00000100:00100000:2.0:1788448548.281553:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902856448:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448548.281626:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80873bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+13:2355:x1875323902856448:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 74us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448548.281634:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 302 00000100:00080000:2.0:1788448548.281701:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448548.282128:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856704 00000100:00100000:1.0:1788448548.282134:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856704 00000100:00100000:1.0:1788448548.282182:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902856832 00000100:00100000:1.0:1788448548.282205:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902856832 00000100:00100000:1.0:1788448548.282237:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:1.0:1788448548.282246:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2355:x1875323902856704:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448548.282292:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+8:2355:x1875323902856704:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 47us (1354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448548.282298:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:1.0:1788448548.282314:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:1.0:1788448548.282319:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902856832:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448548.282376:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2355:x1875323902856832:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 57us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448548.282383:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00080000:2.0:1788448548.283398:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448548.283407:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448548.384400:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448549.408448:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788448549.472587:0:6880:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 410079397542ns, next at 411079393977ns, rc = 0 00000100:00100000:3.0:1788448549.472823:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926954752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448549.472923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448549.473063:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954752 00000100:00100000:2.0:1788448549.473073:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954752 00000100:00100000:2.0:1788448549.473160:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448549.473171:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926954752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448549.473245:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448549.473298:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926954752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448549.473306:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1788448549.473600:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448549.473649:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926954752:0@lo:13:osp-pre-0-0.0 00000001:00080000:1.0:1788448550.032962:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:1.0:1788448550.032978:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:2.0:1788448550.086540:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1788448550.086582:0:5859:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff99a80757a900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1788448550.086588:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a807431700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff99a80757ac00 00000020:00080000:2.0:1788448550.086616:0:5859:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff99a807431400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff99a83fc3e400 00000004:00080000:2.0:1788448550.086646:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 10 committed 00000020:00080000:0.0:1788448550.086806:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1788448550.086999:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1788448550.088398:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448550.088430:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926954880:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788448550.088536:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448550.088962:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926954880 00000100:00100000:1.0:1788448550.088970:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926954880 00000100:00100000:1.0:1788448550.089027:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448550.089036:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8075b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926954880:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1788448550.089298:0:6683:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1788448550.089302:0:6683:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1788448542 -> 1788448542 00002000:00010000:1.0:1788448550.089305:0:6683:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 1788448541 -> 1788448541 00002000:00010000:1.0:1788448550.089307:0:6683:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1788448542 -> 1788448542 00002000:00010000:1.0:1788448550.089309:0:6683:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1788448550.089359:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8075b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1875323926954880:12345-0@lo:2:osp-syn-0-0.0 Request processed in 323us (822us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1788448550.089366:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788448550.089468:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1788448550.089475:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1788448550.089499:0:3312:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff99a83fc10e00 x1875323926954880/t4294967324(4294967324) o2->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788448566 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1788448550.089512:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a83fc10e00/2, rc 0, transno 4294967324 00000100:00100000:3.0:1788448550.089518:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc10e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926954880:0@lo:2:osp-syn-0-0.0 00000040:00080000:3.0:1788448550.241219:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788448550.241229:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788448550.241557:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1788448550.241564:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788448550.432705:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448551.457829:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448551.520919:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926955392:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521017:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521107:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788448551.521114:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926955008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521600:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521634:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926955520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521667:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521698:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926955136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521744:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a810d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926955648:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521766:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521788:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448551.521794:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8075b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926955264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.521814:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448551.521850:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955392 00000100:00100000:0.0:1788448551.521859:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955392 00000100:00100000:0.0:1788448551.521926:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955648 00000100:00100000:0.0:1788448551.521929:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955648 00000100:00100000:0.0:1788448551.521955:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788448551.521964:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926955392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522026:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a810d6ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926955392:12345-0@lo:400:kworker.0 Request processed in 62us (1009us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.522034:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788448551.522126:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788448551.522470:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926955648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522514:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926955648:12345-0@lo:400:kworker.0 Request processed in 48us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.522522:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788448551.522553:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955520 00000100:00100000:0.0:1788448551.522557:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955520 00000100:00100000:0.0:1788448551.522589:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955136 00000100:00100000:0.0:1788448551.522592:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955136 00000100:00100000:0.0:1788448551.522602:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955264 00000100:00100000:0.0:1788448551.522605:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955264 00000100:00100000:0.0:1788448551.522617:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788448551.522624:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926955520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522656:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835ab9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926955520:12345-0@lo:400:kworker.0 Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.522662:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1788448551.522673:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788448551.522678:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926955136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522703:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835aba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926955136:12345-0@lo:400:kworker.0 Request processed in 26us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.522709:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788448551.522720:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788448551.522726:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926955264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522751:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835abad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926955264:12345-0@lo:400:kworker.0 Request processed in 26us (935us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.522756:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788448551.522812:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926955264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522836:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926955136:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.522844:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788448551.522851:0:3309:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:0.0:1788448551.522877:0:3309:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a707121500, transno 4294967310 00000100:00100000:0.0:1788448551.522891:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a810d6ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926955648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448551.523236:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955008 00000100:00100000:1.0:1788448551.523243:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955008 00000100:00100000:1.0:1788448551.523283:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788448551.523291:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926955008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448551.523337:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926955008:12345-0@lo:400:kworker.0 Request processed in 48us (1739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448551.523345:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1788448551.527640:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8075bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926955008:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.527673:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926955520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448551.527691:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926955392:0@lo:400:kworker.0 00000100:00080000:2.0:1788448551.528000:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788448551.528011:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448551.528015:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448551.944027:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448551.944584:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857088 00000100:00100000:0.0:1788448551.944600:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857088 00000100:00080000:2.0:1788448551.944774:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448551.944879:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 238 00000100:00100000:0.0:1788448551.944896:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11302:x1875323902857088:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1788448551.945061:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11302:x1875323902857088:12345-192.168.204.37@tcp:60:lhsmtool_posix.0 Request processed in 168us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448551.945072:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 238 00000100:00100000:1.0:1788448551.953275:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448551.953620:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857344 00000100:00100000:0.0:1788448551.953640:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857344 00000100:00100000:0.0:1788448551.953739:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:0.0:1788448551.953753:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+18:11302:x1875323902857344:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448551.954546:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:11302:x1875323902857344:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 786us (1284us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1788448551.954561:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 65 00000100:00100000:1.0:1788448552.032546:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448552.032618:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926955776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448552.032738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448552.033081:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955776 00000100:00100000:3.0:1788448552.033094:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955776 00000100:00100000:3.0:1788448552.033220:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788448552.033235:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926955776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448552.033292:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448552.033362:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926955776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448552.033371:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788448552.033554:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926955776:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448552.136298:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448552.136736:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857472 00000100:00100000:2.0:1788448552.136753:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857472 00000100:00100000:2.0:1788448552.136860:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00100000:2.0:1788448552.136874:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:12101:x1875323902857472:12345-192.168.204.37@tcp:101:lsof.0 00010000:00010000:2.0:1788448552.136906:0:7154:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448552.136933:0:7154:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abe40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510d92 expref: -99 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137027:0:7154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137043:0:7154:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137057:0:7154:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448552.137105:0:7154:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448552.137110:0:7154:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448552.137138:0:7154:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7154 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137169:0:7154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629800/0xd0e9b344b90abe40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d92 expref: 7 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137262:0:7154:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d92 expref: 6 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448552.137273:0:7154:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:2.0:1788448552.137277:0:7154:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448552.137282:0:7154:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:2.0:1788448552.137380:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:12101:x1875323902857472:12345-192.168.204.37@tcp:101:lsof.0 Request processed in 496us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448552.137390:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 239 00000100:00080000:0.0:1788448552.138731:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448552.480618:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448553.395913:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448553.396116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448553.396154:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448553.396282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448553.396308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448553.396449:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857984 00000100:00100000:0.0:1788448553.396461:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857984 00000100:00100000:0.0:1788448553.396552:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857856 00000100:00100000:0.0:1788448553.396555:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857856 00000100:00100000:0.0:1788448553.396579:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:0.0:1788448553.396590:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902857984:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448553.396674:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2353:x1875323902857984:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 86us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448553.396682:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:0.0:1788448553.396700:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:0.0:1788448553.396707:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902857856:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448553.396733:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902857856:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448553.396739:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:0.0:1788448553.396877:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857728 00000100:00100000:0.0:1788448553.396882:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857728 00000100:00100000:0.0:1788448553.396910:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858112 00000100:00100000:0.0:1788448553.396913:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858112 00000100:00100000:0.0:1788448553.396949:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 170 00000100:00100000:0.0:1788448553.396957:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:2353:x1875323902857728:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448553.396997:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:af250c24-64ec-487b-a1ec-11a62017775a+19:2353:x1875323902857728:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 41us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448553.397004:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 170 00000100:00100000:0.0:1788448553.397017:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00100000:0.0:1788448553.397032:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902858112:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448553.397080:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902858112:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 55us (769us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448553.397087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 171 00000100:00080000:3.0:1788448553.398039:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448553.398047:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788448553.398049:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448553.401618:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902857600 00000100:00100000:2.0:1788448553.401642:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902857600 00000100:00100000:2.0:1788448553.401785:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 304 00000100:00100000:2.0:1788448553.401796:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902857600:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448553.401893:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902857600:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 99us (5737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448553.401901:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 304 00010000:00010000:2.0:1788448553.504394:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448554.528465:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448554.596235:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926955904:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788448554.596315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448554.597786:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926955904 00000100:00100000:1.0:1788448554.597797:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926955904 00000100:00100000:1.0:1788448554.597878:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788448554.597889:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926955904:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448554.597929:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448554.598005:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926955904:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (1689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448554.598012:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788448554.598068:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926955904:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448554.598241:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1788448555.161462:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1788448555.161487:0:5859:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1788448555.161512:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1788448555.161524:0:5871:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:2.0:1788448555.212328:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:3.0:1788448555.552493:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448556.577391:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448556.642346:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926956416:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642441:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642503:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788448556.642510:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926956032:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642541:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642567:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926956544:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642606:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642635:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926956288:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642659:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642679:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448556.642684:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926956160:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642703:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642719:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926956672:0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642738:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448556.642765:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956032 00000100:00100000:2.0:1788448556.642772:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956032 00000100:00100000:2.0:1788448556.642820:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788448556.642828:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926956032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448556.642893:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926956032:12345-0@lo:400:kworker.0 Request processed in 64us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448556.642901:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1788448556.642950:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926956032:0@lo:400:kworker.0 00000100:00100000:0.0:1788448556.644610:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956416 00000100:00100000:0.0:1788448556.644623:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956416 00000100:00100000:0.0:1788448556.644686:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956672 00000100:00100000:0.0:1788448556.644691:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956672 00000100:00100000:0.0:1788448556.644714:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788448556.644723:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926956416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448556.644799:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926956416:12345-0@lo:400:kworker.0 Request processed in 78us (2358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448556.644806:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788448556.644823:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448556.644830:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926956672:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788448556.645019:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788448556.645024:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448556.645323:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926956672:12345-0@lo:400:kworker.0 Request processed in 481us (2570us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448556.645330:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788448556.645355:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956544 00000100:00100000:0.0:1788448556.645359:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956544 00000100:00100000:0.0:1788448556.645448:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956288 00000100:00100000:0.0:1788448556.645452:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956288 00000100:00100000:2.0:1788448556.646465:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834877800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926956672:0@lo:400:kworker.0 00000100:00100000:1.0:1788448556.647606:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956160 00000100:00100000:1.0:1788448556.647619:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956160 00000100:00100000:1.0:1788448556.647676:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788448556.647686:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926956544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448556.647767:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926956544:12345-0@lo:400:kworker.0 Request processed in 82us (5159us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448556.647775:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788448556.647798:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788448556.647805:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926956160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448556.648030:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926956160:12345-0@lo:400:kworker.0 Request processed in 224us (5324us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448556.648088:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1788448556.648289:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc65c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926956544:0@lo:400:kworker.0 00000100:00100000:1.0:1788448556.648306:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1788448556.648323:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a83fc10e00, transno 4294967324 00000100:00100000:1.0:1788448556.648337:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926956416:0@lo:400:kworker.0 00000100:00080000:3.0:1788448556.649694:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448556.653079:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788448556.653097:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926956288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448556.653343:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926956288:12345-0@lo:400:kworker.0 Request processed in 252us (10682us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448556.653365:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788448556.655052:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926956160:0@lo:400:kworker.0 00000100:00100000:3.0:1788448556.660040:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926956288:0@lo:400:kworker.0 00000001:02000400:2.0:1788448557.063374:0:12821:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 11:15:53 (1788448553) 00000100:00100000:1.0:1788448557.152411:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448557.152439:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926956800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448557.152515:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448557.152642:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956800 00000100:00100000:0.0:1788448557.152651:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956800 00000100:00100000:0.0:1788448557.152719:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788448557.152729:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926956800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788448557.152766:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448557.152812:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834875c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926956800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448557.152820:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788448557.152901:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926956800:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1788448557.606352:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448558.514724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448558.517467:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448558.517531:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448558.517566:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448558.517752:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448558.518002:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858240 00000100:00100000:2.0:1788448558.518019:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858240 00000100:00100000:2.0:1788448558.518105:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 306 00000100:00100000:2.0:1788448558.518135:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902858240:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448558.518267:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808727850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+13:2353:x1875323902858240:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 137us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448558.518290:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 306 00000100:00100000:2.0:1788448558.518381:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858624 00000100:00100000:2.0:1788448558.518386:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858624 00000100:00100000:2.0:1788448558.518436:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858496 00000100:00100000:2.0:1788448558.518439:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858496 00000100:00100000:2.0:1788448558.518468:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:2.0:1788448558.518475:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902858624:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448558.518510:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+5:2352:x1875323902858624:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 36us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448558.518518:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:2.0:1788448558.518533:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:2.0:1788448558.518539:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902858496:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448558.518564:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:af250c24-64ec-487b-a1ec-11a62017775a+7:2353:x1875323902858496:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (997us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448558.518571:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00080000:2.0:1788448558.518602:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788448558.518607:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448558.523649:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858368 00000100:00100000:0.0:1788448558.523681:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858368 00000100:00080000:3.0:1788448558.524711:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448558.525132:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902858752 00000100:00100000:0.0:1788448558.525143:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902858752 00000100:00100000:0.0:1788448558.525217:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:0.0:1788448558.525231:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:2352:x1875323902858368:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448558.525346:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+18:2352:x1875323902858368:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 118us (10637us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448558.525354:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 175 00000100:00100000:0.0:1788448558.525377:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00100000:0.0:1788448558.525385:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902858752:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448558.525410:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807976d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902858752:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (7744us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448558.525415:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 176 00000100:00080000:3.0:1788448558.526447:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788448558.624735:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448559.648978:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448559.712471:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448559.712507:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926956928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448559.712604:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448559.712711:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926956928 00000100:00100000:2.0:1788448559.712721:0:6685:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926956928 00000100:00100000:2.0:1788448559.712790:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788448559.712814:0:6685:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926956928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448559.712860:0:6685:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448559.712911:0:6685:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926956928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448559.712919:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1788448559.712944:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448559.712993:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d1a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926956928:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1788448560.480802:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788448560.480811:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788448560.481738:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1788448560.481747:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788448560.673173:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448561.696826:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448561.761072:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926957056:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761161:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761258:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926957568:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761287:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761316:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788448561.761322:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926957440:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761350:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761385:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926957312:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761410:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761427:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788448561.761433:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926957184:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761454:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761473:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926957696:0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761494:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448561.761530:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957440 00000100:00100000:2.0:1788448561.761538:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957440 00000100:00100000:2.0:1788448561.761593:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957696 00000100:00100000:2.0:1788448561.761597:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957696 00000100:00100000:2.0:1788448561.761621:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788448561.761642:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926957440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448561.761697:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926957440:12345-0@lo:400:kworker.0 Request processed in 57us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448561.761704:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448561.762236:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957568 00000100:00100000:0.0:1788448561.762241:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957568 00000100:00100000:0.0:1788448561.762274:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957312 00000100:00100000:0.0:1788448561.762277:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957312 00000100:00100000:0.0:1788448561.762291:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957184 00000100:00100000:0.0:1788448561.762293:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957184 00000100:00100000:0.0:1788448561.762307:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788448561.762314:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926957568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.762359:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926957568:12345-0@lo:400:kworker.0 Request processed in 46us (1072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448561.762366:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788448561.762382:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788448561.762389:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926957312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.762421:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926957312:12345-0@lo:400:kworker.0 Request processed in 34us (1011us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448561.762427:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788448561.762438:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788448561.762444:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926957184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.762470:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926957184:12345-0@lo:400:kworker.0 Request processed in 27us (1016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448561.762477:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788448561.762536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788448561.762553:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926957696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.762587:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc11880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926957696:12345-0@lo:400:kworker.0 Request processed in 35us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448561.762592:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:0.0:1788448561.762615:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788448561.762619:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448561.762621:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448561.762671:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926957440:0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.762683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926957568:0@lo:400:kworker.0 00000100:00100000:3.0:1788448561.764451:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957056 00000100:00100000:3.0:1788448561.764467:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957056 00000100:00100000:0.0:1788448561.764795:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926957184:0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.764811:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926957696:0@lo:400:kworker.0 00000100:00100000:0.0:1788448561.764824:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926957312:0@lo:400:kworker.0 00000100:00100000:3.0:1788448561.765005:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788448561.765016:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926957056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448561.765206:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926957056:12345-0@lo:400:kworker.0 Request processed in 191us (4044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448561.765233:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788448561.765365:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926957056:0@lo:400:kworker.0 00000100:00100000:0.0:1788448562.072875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448562.073089:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902859008 00000100:00100000:2.0:1788448562.073106:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902859008 00000100:00100000:2.0:1788448562.073896:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00100000:2.0:1788448562.073919:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+18:12322:x1875323902859008:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:2.0:1788448562.074934:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+19:12322:x1875323902859008:12345-192.168.204.37@tcp:35:umount.0 Request processed in 1013us (2070us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788448562.074948:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 66 00000100:00080000:0.0:1788448562.075605:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448562.082757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448562.083718:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902859264 00000100:00100000:1.0:1788448562.083736:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902859264 00000100:00100000:1.0:1788448562.083837:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:1.0:1788448562.083851:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+19:12322:x1875323902859264:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:1.0:1788448562.084438:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:af250c24-64ec-487b-a1ec-11a62017775a+20:12322:x1875323902859264:12345-192.168.204.37@tcp:35:umount.0 Request processed in 587us (1698us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1788448562.084448:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 67 00000100:00100000:3.0:1788448562.087380:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448562.087657:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902859520 00000100:00100000:2.0:1788448562.087672:0:5841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902859520 00000100:00100000:2.0:1788448562.087767:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:2.0:1788448562.087780:0:5841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8074f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+20:12322:x1875323902859520:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:2.0:1788448562.088132:0:5841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8074f4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:af250c24-64ec-487b-a1ec-11a62017775a+21:12322:x1875323902859520:12345-192.168.204.37@tcp:35:umount.0 Request processed in 353us (769us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1788448562.088142:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 68 00000100:00100000:2.0:1788448562.091750:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448562.091886:0:12470:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902859776 00000100:00100000:0.0:1788448562.091902:0:12470:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902859776 00000100:00100000:0.0:1788448562.091983:0:12470:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:0.0:1788448562.091997:0:12470:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+21:12322:x1875323902859776:12345-192.168.204.37@tcp:35:umount.0 00000100:00100000:0.0:1788448562.096537:0:12470:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc12680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:af250c24-64ec-487b-a1ec-11a62017775a+22:12322:x1875323902859776:12345-192.168.204.37@tcp:35:umount.0 Request processed in 4521us (4780us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1788448562.096555:0:12470:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 69 00000100:00100000:3.0:1788448562.099597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448562.099648:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448562.100867:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902859904 00000100:00100000:1.0:1788448562.100891:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902859904 00000100:00100000:1.0:1788448562.100992:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902860032 00000100:00100000:1.0:1788448562.100996:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902860032 00000100:00100000:1.0:1788448562.101029:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448562.101042:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80486e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+14:2354:x1875323902859904:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448562.101067:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448562.101121:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246a00/0xd0e9b344b90aaebf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051091d expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448562.101146:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448562.101547:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80486e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+13:2354:x1875323902859904:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 506us (1963us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448562.101557:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448562.101633:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1788448562.101642:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+12:2354:x1875323902860032:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448562.101652:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448562.101665:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247400/0xd0e9b344b90aae25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05108e5 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448562.101678:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448562.101697:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+11:2354:x1875323902860032:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 57us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448562.101704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448562.102975:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448562.103252:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902860160 00000100:00100000:0.0:1788448562.103273:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902860160 00000100:00100000:0.0:1788448562.103364:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00100000:0.0:1788448562.103378:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+5:2351:x1875323902860160:12345-192.168.204.37@tcp:9:umount.0 00000020:00000080:0.0:1788448562.103442:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90ab197 00000100:00080000:0.0:1788448562.103458:0:6682:0:(import.c:65:import_set_state_nolock()) ffff99a80890d800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448562.103513:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788448562.103524:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:0.0:1788448562.103909:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:af250c24-64ec-487b-a1ec-11a62017775a+2:2351:x1875323902860160:12345-192.168.204.37@tcp:9:umount.0 Request processed in 532us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448562.103918:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 73 00000100:00080000:2.0:1788448562.104053:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788448562.110841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448562.110999:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902860544 00000100:00100000:0.0:1788448562.111014:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902860544 00000100:00100000:3.0:1788448562.111107:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448562.111120:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 74 00000100:00100000:0.0:1788448562.111134:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+7:2351:x1875323902860544:12345-192.168.204.37@tcp:9:umount.0 00000100:00100000:3.0:1788448562.111137:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902860672 00000100:00100000:3.0:1788448562.111141:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902860672 00000100:00100000:3.0:1788448562.111182:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000020:00000080:0.0:1788448562.111183:0:6683:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90ab3f8 00000100:00100000:3.0:1788448562.111226:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+11:2355:x1875323902860672:12345-192.168.204.37@tcp:103:ldlm_bl.0 00000020:00010000:0.0:1788448562.111235:0:6683:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99a82949b000: total 0 00000100:00080000:0.0:1788448562.111241:0:6683:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788448562.111242:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448562.111271:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83cc9d400/0xd0e9b344b90ab0a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e8 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:0.0:1788448562.111301:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00010000:00010000:3.0:1788448562.111309:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448562.111577:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+10:2355:x1875323902860672:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 352us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448562.111586:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1788448562.111638:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:af250c24-64ec-487b-a1ec-11a62017775a+5:2351:x1875323902860544:12345-192.168.204.37@tcp:9:umount.0 Request processed in 509us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448562.111645:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 74 00000020:00010000:0.0:1788448562.111664:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99a82949b000: total 0 00010000:00010000:0.0:1788448562.111685:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a82949b000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1788448562.111742:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ab79b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bbd expref: 4 pid: 6683 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788448562.112594:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788448562.113715:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90abe39 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d8b expref: 3 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.113764:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a82949b000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1788448562.113808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448562.113811:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448562.113815:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448562.122830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448562.122987:0:7154:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902861696 00000100:00100000:0.0:1788448562.123004:0:7154:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902861696 00000100:00100000:0.0:1788448562.123109:0:7154:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 240 00000100:00100000:0.0:1788448562.123123:0:7154:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+22:2351:x1875323902861696:12345-192.168.204.37@tcp:39:umount.0 00000020:00000080:0.0:1788448562.123248:0:7154:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aae33 00000020:00010000:0.0:1788448562.123279:0:7154:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99a83fccb800: total 0 00000100:00080000:0.0:1788448562.123286:0:7154:0:(import.c:65:import_set_state_nolock()) ffff99a83fccc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788448562.123322:0:7154:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000100:00100000:0.0:1788448562.124526:0:7154:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834876d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:af250c24-64ec-487b-a1ec-11a62017775a+21:2351:x1875323902861696:12345-192.168.204.37@tcp:39:umount.0 Request processed in 1396us (1709us total) trans 4294967525 rc 0/0 00000100:00100000:0.0:1788448562.124540:0:7154:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 240 00000020:00010000:3.0:1788448562.125770:0:11159:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99a83fccb800: total 0 00010000:00010000:3.0:1788448562.125857:0:11159:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a83fccb800, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788448562.125908:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448562.125912:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448562.125925:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ab75c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ba8 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.125956:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448562.125959:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788448562.125964:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629000/0xd0e9b344b90abdfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d76 expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.125979:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448562.125982:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448562.125986:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83fc39a00/0xd0e9b344b90ab7fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bd9 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126031:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a804d04500) 00010000:00010000:3.0:1788448562.126035:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448562.126039:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ab119 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109fd expref: 17 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126062:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:3.0:1788448562.126065:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448562.126069:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ca00/0xd0e9b344b90ab0fd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109f6 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126087:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448562.126090:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788448562.126094:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ab786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510bb6 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126106:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448562.126108:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788448562.126112:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90abe24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d84 expref: 14 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126128:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff99a804d04700) 00010000:00010000:3.0:1788448562.126130:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448562.126134:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90abd1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d3e expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126153:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448562.126155:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448562.126166:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9ce00/0xd0e9b344b90ab45a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ae4 expref: 12 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126240:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448562.126243:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788448562.126248:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed400/0xd0e9b344b90ab819 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510be0 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126262:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff99a80bd82a00) 00010000:00010000:3.0:1788448562.126264:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788448562.126268:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9d600/0xd0e9b344b90abaf8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510cb2 expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126283:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff99a829674900) 00010000:00010000:3.0:1788448562.126286:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788448562.126290:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a83cc9da00/0xd0e9b344b90ab67c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510b70 expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126306:0:11159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff99a80bd82d00) 00010000:00010000:3.0:1788448562.126308:0:11159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788448562.126312:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ab16d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510a12 expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448562.126344:0:11159:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a83fccb800, canceled 13 locks, left on hash table 0. 00010000:00010000:3.0:1788448562.126359:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448562.126362:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448562.126364:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448562.272725:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926957824:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448562.272833:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448562.273005:0:8106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957824 00000100:00100000:3.0:1788448562.273017:0:8106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957824 00000100:00100000:3.0:1788448562.273108:0:8106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788448562.273118:0:8106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926957824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448562.273169:0:8106:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448562.273353:0:8106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83fc10e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926957824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 235us (519us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448562.273362:0:8106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788448562.273673:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926957824:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788448562.720473:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448563.360330:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:1.0:1788448563.360343:0:7637:0:(genops.c:885:class_export_put()) final put ffff99a80890e800/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:2.0:1788448563.360490:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80890e800/af250c24-64ec-487b-a1ec-11a62017775a for lustre-OST0001 00000020:00000080:2.0:1788448563.360562:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a80890d800 for lustre-OST0001 00000100:00100000:3.0:1788448563.641917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448563.641975:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448563.642094:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902861952 00000100:00100000:0.0:1788448563.642107:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902861952 00000100:00100000:0.0:1788448563.642251:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:0.0:1788448563.642264:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902861952:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448563.642377:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2353:x1875323902861952:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 115us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448563.642386:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 180 00000100:00100000:2.0:1788448563.642752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902861824 00000100:00100000:2.0:1788448563.642778:0:5831:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902861824 00000100:00100000:2.0:1788448563.642822:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 308 00000100:00100000:2.0:1788448563.642832:0:5831:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902861824:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448563.642876:0:5831:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808725850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:188c2354-2939-43ce-85d0-cb78875d8855+10:2353:x1875323902861824:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 46us (900us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448563.642883:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 308 00000100:00080000:3.0:1788448563.643275:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788448563.744456:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.769592:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448564.832767:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926957952:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448564.832854:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448564.833023:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926957952 00000100:00100000:0.0:1788448564.833032:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926957952 00000100:00100000:0.0:1788448564.833104:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788448564.833114:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926957952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448564.833169:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1788448564.833280:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448564.837899:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926957952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4773us (5031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448564.837914:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788448564.841002:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926957952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448564.895619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448564.895661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448564.895664:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862080 00000100:00100000:0.0:1788448564.895675:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862080 00000100:00100000:0.0:1788448564.895738:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862208 00000100:00100000:0.0:1788448564.895756:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862208 00000100:00100000:0.0:1788448564.895784:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:0.0:1788448564.895806:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+11:2355:x1875323902862080:12345-192.168.204.37@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1788448564.895822:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00010000:00010000:0.0:1788448564.895823:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1788448564.895830:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+11:2355:x1875323902862208:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448564.895837:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448564.895845:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178e00/0xd0e9b344b90aaf0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba051095c expref: 11 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448564.895845:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90aaf05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510932 expref: 11 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448564.895863:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448564.895863:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448564.895912:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+9:2355:x1875323902862080:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 120us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448564.895919:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:3.0:1788448564.903731:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:188c2354-2939-43ce-85d0-cb78875d8855+8:2355:x1875323902862208:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 7889us (8056us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448564.903746:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:1.0:1788448564.903783:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448564.904212:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862336 00000100:00100000:2.0:1788448564.904223:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862336 00000100:00100000:2.0:1788448564.904278:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:2.0:1788448564.904288:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+8:2354:x1875323902862336:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448564.904302:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448564.904325:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842178000/0xd0e9b344b90ab0a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba05109e1 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448564.904343:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448564.910520:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:188c2354-2939-43ce-85d0-cb78875d8855+7:2354:x1875323902862336:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 6220us (6727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448564.910733:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:3.0:1788448564.910815:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448564.910842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862592 00000100:00100000:2.0:1788448564.910853:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862592 00000100:00100000:2.0:1788448564.910902:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:2.0:1788448564.910912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+6:2351:x1875323902862592:12345-192.168.204.37@tcp:39:umount.0 00000020:00000080:2.0:1788448564.910957:0:5837:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aaf1a 00000020:00010000:2.0:1788448564.910968:0:5837:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99a834f6d800: total 0 00000100:00080000:2.0:1788448564.910974:0:5837:0:(import.c:65:import_set_state_nolock()) ffff99a834f68800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448564.910998:0:5837:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1788448564.911210:0:5825:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99a834f6d800: total 0 00010000:00010000:3.0:1788448564.911215:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448564.911528:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:dde44bfc-ee66-4f31-86da-76b8fbe861b2+5:2351:x1875323902862592:12345-192.168.204.37@tcp:39:umount.0 Request processed in 615us (713us total) trans 4294967526 rc 0/0 00010000:00010000:3.0:1788448564.911534:0:5825:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a834f6d800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1788448564.911571:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a829674c00) 00010000:00010000:3.0:1788448564.911575:0:5825:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448564.911583:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810629400/0xd0e9b344b90abe47 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510d92 expref: 5 pid: 7154 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448564.911609:0:5825:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a834f6d800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1788448564.911620:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.911622:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448564.911624:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448564.911727:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 241 00000100:00100000:0.0:1788448564.928051:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448564.928235:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862848 00000100:00100000:3.0:1788448564.928247:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862848 00000100:00100000:3.0:1788448564.928316:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 309 00000100:00100000:3.0:1788448564.928328:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+7:2351:x1875323902862848:12345-192.168.204.37@tcp:251:umount.0 00000020:00000080:3.0:1788448564.928375:0:5829:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aae10 00000020:00010000:3.0:1788448564.928383:0:5829:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99a83e5ee800: total 0 00000100:00080000:3.0:1788448564.928387:0:5829:0:(import.c:65:import_set_state_nolock()) ffff99a83fcca800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1788448564.928473:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808724850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:188c2354-2939-43ce-85d0-cb78875d8855+3:2351:x1875323902862848:12345-192.168.204.37@tcp:251:umount.0 Request processed in 147us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448564.928481:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 309 00000020:00010000:0.0:1788448564.928606:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99a83e5ee800: total 0 00010000:00010000:0.0:1788448564.928662:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a83e5ee800, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788448564.928696:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809247000/0xd0e9b344b90aaec6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510924 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448564.928712:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a83e5ee800, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1788448564.928722:0:5826:0:(genops.c:885:class_export_put()) final put ffff99a83e5ee800/188c2354-2939-43ce-85d0-cb78875d8855 00010000:00010000:0.0:1788448564.928740:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448564.928742:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448564.928744:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788448564.931328:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e5ee800/188c2354-2939-43ce-85d0-cb78875d8855 for MGS 00000020:00000080:3.0:1788448564.931536:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83fcca800 for MGS 00000001:00100000:0.0:1788448565.422355:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000001:00080000:0.0:1788448565.422375:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:0.0:1788448565.422396:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000001:00080000:0.0:1788448565.422401:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:0.0:1788448565.422404:0:5859:0:(genops.c:885:class_export_put()) final put ffff99a834f6d800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 00000020:00000080:0.0:1788448565.422423:0:5859:0:(genops.c:885:class_export_put()) final put ffff99a83fccb800/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:0.0:1788448565.422455:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a834f6d800/dde44bfc-ee66-4f31-86da-76b8fbe861b2 for lustre-MDT0000 00000020:00000080:0.0:1788448565.422647:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83fccb800/af250c24-64ec-487b-a1ec-11a62017775a for lustre-MDT0000 00000020:00000080:0.0:1788448565.422680:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a834f68800 for lustre-MDT0000 00000020:00000080:0.0:1788448565.422685:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83fccc800 for lustre-MDT0000 00000001:00100000:0.0:1788448565.426000:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:0.0:1788448565.426011:0:6707:0:(genops.c:885:class_export_put()) final put ffff99a82949b000/af250c24-64ec-487b-a1ec-11a62017775a 00000020:00000080:3.0:1788448565.426693:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a82949b000/af250c24-64ec-487b-a1ec-11a62017775a for lustre-OST0000 00000020:00000080:3.0:1788448565.426752:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a829498800 for lustre-OST0000 00010000:00010000:3.0:1788448565.809624:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448566.820393:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448566.881511:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926958336:0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.881597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448566.881671:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788448566.881678:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926958208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.881703:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448566.881720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926958720:0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.881745:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448566.881782:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958336 00000100:00100000:3.0:1788448566.881789:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958336 00000100:00100000:3.0:1788448566.881843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958208 00000100:00100000:3.0:1788448566.881847:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958208 00000100:00100000:3.0:1788448566.881871:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788448566.881880:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926958336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.881938:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1875323926958336:12345-0@lo:400:kworker.0 Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448566.881946:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1788448566.881964:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788448566.881969:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926958208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.881993:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926958208:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448566.881998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788448566.882017:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958720 00000100:00100000:3.0:1788448566.882020:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958720 00000100:00100000:3.0:1788448566.882045:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448566.882052:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926958720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.882084:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926958720:12345-0@lo:400:kworker.0 Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448566.882090:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00080000:3.0:1788448566.882107:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788448566.882128:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448566.882164:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926958208:0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.882175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926958720:0@lo:400:kworker.0 00000100:00100000:3.0:1788448566.882209:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3310:1875323926958336:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882473:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926958080:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882515:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448566.882544:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926958592:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882566:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448566.882600:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788448566.882607:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926958464:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882628:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448566.882658:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958592 00000100:00100000:1.0:1788448566.882662:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958592 00000100:00100000:1.0:1788448566.882691:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788448566.882698:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926958592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882733:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834874000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926958592:12345-0@lo:400:kworker.0 Request processed in 36us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448566.882740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1788448566.882758:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958464 00000100:00100000:1.0:1788448566.882761:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958464 00000100:00100000:1.0:1788448566.882786:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448566.882792:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926958464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882822:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834877800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926958464:12345-0@lo:400:kworker.0 Request processed in 31us (193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448566.882827:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1788448566.882845:0:5830:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958080 00000100:00100000:1.0:1788448566.882848:0:5830:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958080 00000100:00100000:1.0:1788448566.882872:0:5830:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1788448566.882879:0:5830:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926958080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882909:0:5830:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a808726450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3312:x1875323926958080:12345-0@lo:400:kworker.0 Request processed in 32us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448566.882925:0:5830:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:1.0:1788448566.882960:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448566.882964:0:5833:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448566.882982:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926958464:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.882991:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926958080:0@lo:400:kworker.0 00000100:00100000:1.0:1788448566.883000:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926958592:0@lo:400:kworker.0 00000020:01000004:1.0:1788448567.327139:0:13021:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788448567.344760:0:13021:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788448567.344828:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.344844:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.344850:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.344857:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.344883:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448567.344889:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788448567.344912:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448567.344919:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448567.344927:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448567.344960:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a83ce8c000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1788448567.346884:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448567.346896:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.346907:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ede00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448567.346911:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.346921:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448567.346928:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448567.346933:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448567.346936:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788448567.346938:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788448567.346987:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.346993:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448567.347028:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.347036:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a8092ede00/0xd0e9b344b90aae95 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae9c expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.347052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448567.347054:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448567.347073:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448567.347096:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926958848:0@lo:39:umount.0 00000100:00100000:2.0:1788448567.347281:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.347357:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448567.347365:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926958976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.347392:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.347430:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958848 00000100:00100000:2.0:1788448567.347437:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958848 00000100:00100000:2.0:1788448567.347481:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1788448567.347490:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875323926958848:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788448567.347516:0:5838:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aac1f 00000100:00080000:2.0:1788448567.347525:0:5838:0:(import.c:65:import_set_state_nolock()) ffff99a8092e1800 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1788448567.347586:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3308:x1875323926958848:12345-0@lo:39:umount.0 Request processed in 97us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.347593:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1788448567.347606:0:5838:0:(genops.c:885:class_export_put()) final put ffff99a8092e6800/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:2.0:1788448567.347630:0:6696:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926958976 00000100:00100000:2.0:1788448567.347634:0:6696:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926958976 00000100:00100000:2.0:1788448567.347666:0:6696:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788448567.347672:0:6696:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3309:x1875323926958976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448567.347682:0:6696:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448567.347698:0:6696:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810628000/0xd0e9b344b90aae9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aae95 expref: 19 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.347712:0:6696:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448567.347739:0:6696:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8295ad880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3309:x1875323926958976:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.347745:0:6696:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:2.0:1788448567.347773:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788448567.347782:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8092e6800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448567.347827:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a8092e1800 for lustre-MDT0000 00000100:00100000:2.0:1788448567.347867:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:623f2df2-d49f-4f54-8e7f-befebe2e7643:3309:1875323926958976:0@lo:103:ldlm_bl.0 00000100:00080000:2.0:1788448567.347895:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83ce8c000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788448567.347904:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926958848:0@lo:39:umount.0 00000100:00080000:1.0:1788448567.348064:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448567.348075:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788448567.348081:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788448567.348962:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.348976:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.348984:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.348990:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349014:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448567.349020:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349027:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349034:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349040:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349051:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788448567.349058:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349078:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349084:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349090:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349100:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788448567.349117:0:13021:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349124:0:13021:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349130:0:13021:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349136:0:13021:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.349144:0:13021:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1788448567.349147:0:13021:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1788448567.349171:0:13021:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1788448567.349176:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1788448567.349180:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.349211:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/5 00000020:00080000:1.0:1788448567.349217:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99a83fcca000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448567.349230:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff99a7047e8800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448567.349235:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff99a8075699b8) has exports, disconnecting them 00000020:00080000:1.0:1788448567.349240:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99a83fcca000), last request at 1788448566 00000020:00000080:1.0:1788448567.349245:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad92 00000100:00080000:1.0:1788448567.349262:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a83fccb000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788448567.349306:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a83fcca000): rc 0 00000020:00000080:1.0:1788448567.349309:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83fcca000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1788448567.349316:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff99a7047e8800), last request at 1788448566 00000020:00000080:1.0:1788448567.349320:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aacc7 00000100:00080000:1.0:1788448567.349326:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a7047ef000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788448567.349333:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a7047e8800): rc 0 00000020:00000080:1.0:1788448567.349335:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a7047e8800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1788448567.349342:0:13021:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbbcbc18d3ae0 00000100:00080000:1.0:1788448567.349362:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448567.349365:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:1.0:1788448567.349375:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448567.349437:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788448567.349457:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a83d43a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788448567.349471:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448567.349473:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1788448567.349484:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788448567.349539:0:13021:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788448567.349549:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a83e5ec000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1788448567.349577:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99a8075699b8) has no exports 00000020:00000080:2.0:1788448567.349933:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83fcca000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448567.349970:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a7047e8800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788448567.349994:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83fccb000 for lustre-MDT0000 00000020:00000080:2.0:1788448567.349998:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a7047ef000 for lustre-MDT0000 00010000:00010000:2.0:1788448567.350007:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788448567.350013:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350022:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448567.350026:0:11159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350035:0:11159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448567.350043:0:11159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448567.350049:0:11159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448567.350051:0:11159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:2.0:1788448567.350054:0:11159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:2.0:1788448567.350083:0:11159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350100:0:11159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448567.350136:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350142:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809247600/0xd0e9b344b90aaea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aaeaa expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350156:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788448567.350160:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350165:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448567.350168:0:11159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350177:0:11159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448567.350182:0:11159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448567.350207:0:11159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448567.350210:0:11159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788448567.350212:0:11159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788448567.350468:0:11159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350475:0:11159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448567.350482:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350498:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90aadca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aadd1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350512:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788448567.350516:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350522:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448567.350526:0:11159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350532:0:11159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448567.350538:0:11159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448567.350543:0:11159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788448567.350545:0:11159:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788448567.350547:0:11159:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788448567.350577:0:11159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350583:0:11159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448567.350600:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350606:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809247e00/0xd0e9b344b90ab0cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90ab0d3 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350625:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448567.350628:0:11159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350634:0:11159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810628e00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448567.350637:0:11159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350644:0:11159:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448567.350650:0:11159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448567.350655:0:11159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448567.350657:0:11159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788448567.350659:0:11159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788448567.350672:0:11159:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350677:0:11159:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448567.350683:0:11159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350689:0:11159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810628e00/0xd0e9b344b90aab7e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aab85 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.350701:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448567.350702:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448567.350709:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448567.350731:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926959360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.350811:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.350862:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448567.350867:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926959488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.350889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.350917:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926959744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.350936:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.350953:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788448567.350958:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926959616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.350977:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.351003:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959360 00000100:00100000:2.0:1788448567.351010:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959360 00000100:00100000:0.0:1788448567.352589:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788448567.352611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:0:1875323926959872:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448567.352737:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959488 00000100:00100000:2.0:1788448567.352744:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959488 00000100:00100000:2.0:1788448567.352771:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959744 00000100:00100000:2.0:1788448567.352774:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959744 00000100:00100000:2.0:1788448567.352787:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959616 00000100:00100000:2.0:1788448567.352790:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959616 00000100:00100000:2.0:1788448567.352807:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448567.352816:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80486e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+21:3311:x1875323926959360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448567.352831:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448567.352852:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629600/0xd0e9b344b90aaeaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aaea3 expref: 21 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.352872:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448567.352928:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80486e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+20:3311:x1875323926959360:12345-0@lo:103:ldlm_bl.0 Request processed in 113us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.352935:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448567.352997:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448567.353003:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+19:3311:x1875323926959488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448567.353011:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448567.353019:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810628200/0xd0e9b344b90aadd1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aadca expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.354608:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448567.354683:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+18:3311:x1875323926959488:12345-0@lo:103:ldlm_bl.0 Request processed in 1674us (3787us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.354696:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448567.354724:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448567.354737:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+17:3310:x1875323926959744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448567.354751:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448567.354783:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a800031a00/0xd0e9b344b90aab85 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aab7e expref: 17 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448567.354804:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448567.355523:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448567.355542:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448567.355557:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+16:3310:x1875323926959616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788448567.355570:0:5822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448567.355583:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ed600/0xd0e9b344b90ab0d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90ab0cc expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448567.355594:0:5822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448567.355770:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926959744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.358348:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:623f2df2-d49f-4f54-8e7f-befebe2e7643+15:3310:x1875323926959744:12345-0@lo:103:ldlm_bl.0 Request processed in 3604us (7398us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.358364:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:2.0:1788448567.358432:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448567.358470:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8359d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926959488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.358482:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83fc11f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:623f2df2-d49f-4f54-8e7f-befebe2e7643:3311:1875323926959360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.358523:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926959104:0@lo:9:umount.0 00000100:00100000:3.0:1788448567.360811:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:623f2df2-d49f-4f54-8e7f-befebe2e7643+14:3310:x1875323926959616:12345-0@lo:103:ldlm_bl.0 Request processed in 5250us (9823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448567.360825:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448567.360892:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:623f2df2-d49f-4f54-8e7f-befebe2e7643:3310:1875323926959616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448567.362065:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.362122:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926959232:0@lo:9:umount.0 00000100:00100000:2.0:1788448567.362207:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448567.362271:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959104 00000100:00100000:2.0:1788448567.362279:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959104 00000100:00100000:2.0:1788448567.362323:0:12065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926959232 00000100:00100000:2.0:1788448567.362327:0:12065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926959232 00000100:00100000:2.0:1788448567.362353:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448567.362361:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875323926959104:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788448567.362395:0:12065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad14 00000100:00080000:2.0:1788448567.362408:0:12065:0:(import.c:65:import_set_state_nolock()) ffff99a704c30800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448567.362455:0:12065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1788448567.362830:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3308:x1875323926959104:12345-0@lo:9:umount.0 Request processed in 469us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.362838:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448567.362856:0:12065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788448567.362862:0:12065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3308:x1875323926959232:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788448567.362874:0:12065:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aadfb 00000100:00080000:2.0:1788448567.362881:0:12065:0:(import.c:65:import_set_state_nolock()) ffff99a83fcce800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788448567.362899:0:12065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1788448567.363094:0:12065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3308:x1875323926959232:12345-0@lo:9:umount.0 Request processed in 230us (884us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448567.363112:0:12065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1788448567.363140:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448567.363170:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83d43a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788448567.363217:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788448567.363220:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788448567.363224:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926959104:0@lo:9:umount.0 00000100:00080000:2.0:1788448567.363239:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83e5ec000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1788448567.363249:0:3308:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1788448567.363261:0:3308:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788448567.363265:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926959232:0@lo:9:umount.0 00010000:00010000:3.0:1788448567.366967:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788448567.387680:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff99a8075699b8) has no exports 00000020:00000080:1.0:1788448567.494967:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aabd9 00000020:00000080:1.0:1788448567.495003:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83e701000/lustre-QMT0000_UUID 00000020:01000000:1.0:1788448567.495093:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1788448567.497247:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448567.497264:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788448567.497269:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff99a83e70b370) has no exports 00000020:00000080:2.0:1788448567.497795:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aabd2 00000020:00000080:2.0:1788448567.497806:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83e719000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788448567.500988:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e701000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1788448567.505003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e719000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788448567.505083:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448567.505094:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1788448567.505112:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83d586800/lustre-QMT0000_UUID 00000020:00000080:3.0:1788448567.505115:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d586800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:3.0:1788448567.505121:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:01000000:3.0:1788448567.505353:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a80648ecc0 - data ffff99a82ec2da20/ffff99a7045e2000 00000020:01000000:3.0:1788448567.505499:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a806406c00 - data ffff99a838f35bd0/ffff99a80872e800 00000001:00000004:1.0:1788448567.545799:0:13021:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1788448567.648138:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788448567.648149:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1788448567.648798:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788448567.648802:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788448567.651486:0:6879:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788448567.651497:0:6879:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1788448567.651511:0:6879:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1788448567.652536:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788448567.652543:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1788448567.652562:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1788448567.652564:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788448567.653482:0:8100:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788448567.653487:0:8100:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1788448567.653498:0:8100:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788448567.707772:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aaba1 00000020:00000080:0.0:1788448567.707787:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a8065bd800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788448567.709629:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aabb6 00000020:00000080:0.0:1788448567.709642:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83d584800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448567.709815:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8065bd800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788448567.709886:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1788448567.709892:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448567.709902:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448567.709906:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff99a80756b370) has no exports 00000004:01000000:0.0:1788448567.710089:0:13021:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1788448567.710110:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aadf4 00000020:00000080:0.0:1788448567.710115:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83e5e8800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448567.710182:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d584800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788448567.710387:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788448567.710441:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.710449:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788448567.710452:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff99a8075e99b8) has no exports 00000020:00000080:1.0:1788448567.710459:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aaded 00000020:00000080:1.0:1788448567.710464:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83e5eb000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448567.710491:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e5e8800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:1.0:1788448567.710964:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788448567.710970:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788448567.710974:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:1.0:1788448567.710980:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448567.710982:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448567.711008:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e5eb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788448567.711158:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.711166:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448567.711172:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad0d 00000020:00000080:1.0:1788448567.711177:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a704c65000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448567.711299:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83e5ec000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788448567.711306:0:38:0:(genops.c:885:class_export_put()) final put ffff99a83e5ef000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448567.711308:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83e5ef000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788448567.711314:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788448567.711491:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788448567.711496:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.711501:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788448567.711504:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff99a83e708000) has no exports 00000020:00000080:1.0:1788448567.711509:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad06 00000020:00000080:1.0:1788448567.711512:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83d43e800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448567.711567:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704c65000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:1.0:1788448567.712063:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788448567.712067:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788448567.712071:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:1.0:1788448567.712075:0:13021:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788448567.712077:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448567.712163:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d43e800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788448567.712408:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.712418:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448567.712448:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.712452:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448567.712468:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a82ea0b000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448567.712471:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a82ea0b000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788448567.712483:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448567.712630:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aabbd 00000020:00000080:1.0:1788448567.712636:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83d583800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788448567.712659:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83d43a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788448567.712725:0:38:0:(genops.c:885:class_export_put()) final put ffff99a704f1a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788448567.712728:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704f1a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788448567.712732:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788448567.712856:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:1.0:1788448567.712861:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.712865:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788448567.712868:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff99a80756cd28) has no exports 00000020:00000080:1.0:1788448567.712888:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.712897:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:1.0:1788448567.712929:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aabc4 00000020:00000080:1.0:1788448567.712934:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83d586000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788448567.712960:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d583800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1788448567.712964:0:38:0:(genops.c:885:class_export_put()) final put ffff99a83d581800/lustre-MDD0000_UUID 00000020:00000080:2.0:1788448567.712966:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d581800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1788448567.712970:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:1.0:1788448567.713149:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a80badd000 from lustre-MDT0000, refs=3 00000020:01000004:1.0:1788448567.713154:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80badd000 3 00000020:01000004:1.0:1788448567.713157:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a80badd000 from lustre-MDT0000 00000020:00000080:1.0:1788448567.713176:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.713180:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:1.0:1788448567.713202:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a8065ba000/lustre-MDT0000_UUID 00000020:00000080:1.0:1788448567.713205:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8065ba000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:1.0:1788448567.713372:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:1.0:1788448567.713401:0:13021:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:1.0:1788448567.713406:0:13021:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:1.0:1788448567.713409:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:1.0:1788448567.713412:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.713415:0:13021:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788448567.713438:0:13021:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff99a8064ac800 623f2df2-d49f-4f54-8e7f-befebe2e7643 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448567.713444:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff99a80649cd28) has exports, disconnecting them 00000020:00080000:1.0:1788448567.713449:0:13021:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff99a8064ac800), last request at 1788448331 00000020:00000080:1.0:1788448567.713558:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aab62 00000020:00010000:1.0:1788448567.713564:0:13021:0:(genops.c:1921:obd_stale_export_put()) Put export ffff99a8064ac800: total 2 00000100:00080000:1.0:1788448567.713576:0:13021:0:(import.c:65:import_set_state_nolock()) ffff99a8064af800 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1788448567.713591:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a8064ac800): rc 0 00000020:00080000:1.0:1788448567.713596:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff99a80649cd28) has no exports 00000020:00010000:1.0:1788448567.713606:0:5826:0:(genops.c:1907:obd_stale_export_get()) Get export ffff99a8064ac800: total 2 00010000:00010000:1.0:1788448567.713629:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff99a8064ac800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1788448567.713662:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246200/0xd0e9b344b90aae72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aae6b expref: 9 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713796:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092eda00/0xd0e9b344b90aae80 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aae79 expref: 8 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713809:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ece00/0xd0e9b344b90aae8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aae87 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713821:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629200/0xd0e9b344b90aaeb8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aaeb1 expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713834:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a809246000/0xd0e9b344b90ab0b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90ab0b0 expref: 5 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713842:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90ab0c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90ab0be expref: 4 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713855:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810759400/0xd0e9b344b90aac7a lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aac73 expref: 3 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713868:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a842179800/0xd0e9b344b90aae64 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xd0e9b344b90aae5d expref: 2 pid: 5830 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448567.713878:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff99a8064ac800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1788448567.713891:0:5826:0:(genops.c:885:class_export_put()) final put ffff99a8064ac800/623f2df2-d49f-4f54-8e7f-befebe2e7643 00000020:00000080:2.0:1788448567.713985:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d586000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:1.0:1788448567.714120:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448567.714123:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448567.714125:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448567.714319:0:5831:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff99a8092a3800:5831] 2 exiting: rc = 0 00000100:00100000:1.0:1788448567.714413:0:5830:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff99a8092a3600:5830] 1 exiting: rc = 0 00000100:00100000:1.0:1788448567.714463:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff99a8092a3400:5829] 0 exiting: rc = 1 00000100:00100000:1.0:1788448567.714517:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714525:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714532:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714538:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714543:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714549:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714554:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714560:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714566:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714572:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714578:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714585:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714591:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714597:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714604:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714610:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714617:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714622:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714629:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714635:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714641:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714647:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714653:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714658:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714675:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714682:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714687:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714693:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714698:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714715:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714721:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714726:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714733:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714738:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714744:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714750:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714756:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714762:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714768:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714775:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714781:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714786:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714792:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714798:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714803:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714808:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714813:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714819:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714825:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714830:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714836:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714841:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714847:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714852:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714856:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714861:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714867:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714871:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714876:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714882:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714887:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714893:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714899:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448567.714904:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1788448567.715494:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788448567.715499:0:13021:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00000080:2.0:1788448567.716380:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8064ac800/623f2df2-d49f-4f54-8e7f-befebe2e7643 for MGS 00000020:00000080:2.0:1788448567.716496:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a8064af800 for MGS 00000020:01000000:1.0:1788448567.716535:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a83e6fc1e0 - data ffff99a83feac000/ffff99a834f3f000 00000020:01000000:1.0:1788448567.716777:0:13021:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a80bad22a0 - data ffff99a80b026288/ffff99a809241400 00000020:00000080:1.0:1788448567.717418:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aab46 00000020:00000080:1.0:1788448567.717426:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a80bb14800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788448567.717474:0:13021:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a80badd000 from MGS, refs=2 00000020:01000004:1.0:1788448567.717478:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80badd000 2 00000020:01000004:1.0:1788448567.717482:0:13021:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a80badd000 from MGS 00000020:00000080:1.0:1788448567.717504:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788448567.717510:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788448567.717513:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a80bb17000/MGS 00000020:00000080:1.0:1788448567.717515:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80bb17000/MGS for MGS 00000020:01000000:1.0:1788448567.717521:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788448567.717570:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788448567.717573:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448567.717578:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788448567.717584:0:13021:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff99a83ce89800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788448567.717589:0:13021:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff99a83e7099b8) has exports, disconnecting them 00000020:00080000:1.0:1788448567.717594:0:13021:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff99a83ce89800), last request at 1788448332 00000020:00000080:1.0:1788448567.717598:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aac11 00000020:00080000:1.0:1788448567.717606:0:13021:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a83ce89800): rc 0 00000020:00000080:1.0:1788448567.717609:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a83ce89800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788448567.717662:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80bb14800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788448567.719129:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83ce89800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1788448567.720260:0:13021:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1788448567.720268:0:13021:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788448567.720273:0:13021:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788448567.720292:0:13021:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788448567.720476:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448567.720484:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1788448567.720491:0:13021:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80badd000 1 00000020:00000080:0.0:1788448567.720497:0:13021:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aab38 00000020:00000080:0.0:1788448567.720509:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a80bb10800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1788448567.720515:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1788448567.720519:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448567.720523:0:13021:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788448567.720527:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff99a807568000) has no exports 00000020:00000080:2.0:1788448567.731022:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83ce8c000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788448567.731041:0:38:0:(genops.c:885:class_export_put()) final put ffff99a82ea14800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788448567.731045:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a82ea14800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788448567.731054:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788448567.731130:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80bb10800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788448567.829997:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448567.830017:0:13021:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1788448567.830023:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a80badb800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788448567.830028:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80badb800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1788448567.830038:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1788448567.830453:0:13021:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a80bada800 00000020:01000000:0.0:1788448567.830480:0:13021:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788448567.830484:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788448567.830489:0:13021:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788448567.830493:0:13021:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff99a80657cd28) has no exports 00000100:00100000:2.0:1788448567.831136:0:5837:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff99a80ba7a800:5837] 0 exiting: rc = 1 00000100:00100000:2.0:1788448567.831585:0:5838:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff99a8092a2400:5838] 1 exiting: rc = 0 00000100:00100000:2.0:1788448567.831649:0:7154:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff99a704688600:7154] 3 exiting: rc = 0 00000100:00100000:2.0:1788448567.833401:0:5839:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff99a809234400:5839] 2 exiting: rc = 0 00000100:00100000:0.0:1788448567.833529:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833537:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833543:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833548:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833555:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833561:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833567:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833572:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833578:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833583:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833588:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833593:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833598:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833616:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833622:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833627:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833633:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833639:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833644:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833648:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833654:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833659:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833677:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833682:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833687:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833692:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833697:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833702:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833707:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833712:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833718:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833723:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833729:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833734:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833739:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833745:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833751:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833756:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833761:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833766:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833771:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833776:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833780:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833786:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833790:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833795:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833801:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833808:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833821:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833827:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833832:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833838:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833843:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833849:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833854:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833860:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833866:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833871:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833876:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833882:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833887:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833893:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833899:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.833904:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.843657:0:12470:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff99a80861c600:12470] 2 exiting: rc = 0 00000100:00100000:0.0:1788448567.845558:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff99a809234a00:5841] 1 exiting: rc = 0 00000100:00100000:2.0:1788448567.845762:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff99a809234600:5840] 0 exiting: rc = 1 00010000:00010000:2.0:1788448567.845816:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448567.845935:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845945:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845952:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845959:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845968:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845974:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845980:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845987:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.845993:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846000:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846006:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846012:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846020:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846026:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846032:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846037:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846042:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846067:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846073:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846078:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846084:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846091:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846110:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846115:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846120:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846125:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846129:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846134:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846139:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846144:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846148:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846164:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846170:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846175:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846180:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846302:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846310:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846316:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846322:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846327:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846332:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846338:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846343:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846348:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846353:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846357:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846362:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846366:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846370:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846375:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846380:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846385:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846399:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846404:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846409:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846415:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846420:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846425:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846429:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846434:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846439:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846443:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846448:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.846453:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847073:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff99a80bafa400:5842] 0 exiting: rc = 1 00000100:00100000:2.0:1788448567.847375:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff99a80bafac00:5843] 1 exiting: rc = 0 00000100:00100000:0.0:1788448567.847491:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847499:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847505:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847512:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847519:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847525:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847532:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847538:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847545:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847551:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847557:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847574:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847582:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847588:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847594:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847600:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847606:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847612:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847618:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847624:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847631:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847636:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.847653:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848799:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848811:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848818:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848824:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848833:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848842:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848848:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848853:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848860:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848866:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848872:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848879:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848902:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848911:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848917:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848922:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848929:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848934:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848939:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848945:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848950:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848956:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848962:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848968:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848974:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.848989:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849009:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849020:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849027:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849034:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849041:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849046:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849053:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849059:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849076:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849083:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849088:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849107:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849113:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849119:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.849134:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.893924:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff99a80bafa000:5844] 0 exiting: rc = 1 00000100:00100000:2.0:1788448567.894043:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff99a80882d800:5845] 1 exiting: rc = 0 00000100:00100000:0.0:1788448567.895378:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895387:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895392:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895398:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895405:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895410:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895416:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895421:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895427:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895432:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895437:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895444:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895449:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895455:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895460:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895468:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895473:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895479:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895484:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895491:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895498:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895505:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895510:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895516:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895521:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895526:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895531:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895536:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895567:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895573:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895578:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895582:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895588:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895594:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895600:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895607:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895613:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895619:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895625:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895631:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895635:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895641:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895647:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895652:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.895658:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896326:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896333:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896338:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896343:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896349:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896353:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896359:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896364:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896369:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896375:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896380:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896386:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896391:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896396:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896401:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896406:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896411:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896415:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.896431:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.903836:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff99a804437000:5847] 1 exiting: rc = 0 00000100:00100000:2.0:1788448567.904029:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff99a804437a00:5846] 0 exiting: rc = 1 00000100:00100000:2.0:1788448567.904101:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904108:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904113:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904131:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904136:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904141:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904146:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904913:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904924:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904930:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904935:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904940:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904945:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904950:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904957:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904961:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904966:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904970:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904976:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904981:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904986:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904991:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.904996:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905001:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905006:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905011:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905017:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905021:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905026:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905031:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905037:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905041:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905045:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905050:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905055:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905061:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905067:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905072:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905088:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905104:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905110:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905115:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905120:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905125:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905130:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905134:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905139:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905144:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905758:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905772:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905778:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905788:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905794:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905799:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905803:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905808:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905813:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905818:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905823:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905828:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905833:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905838:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905844:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.905849:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.907624:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff99a804437c00:5849] 1 exiting: rc = 0 00000100:00100000:0.0:1788448567.907752:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff99a804436000:5848] 0 exiting: rc = 1 00000100:00100000:3.0:1788448567.908305:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908312:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908317:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908323:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908329:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908335:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908340:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908345:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908350:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908355:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908361:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908366:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908371:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908376:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908382:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908387:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908392:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908398:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908403:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908408:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908413:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908418:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908423:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908429:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908433:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908438:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908443:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908448:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908453:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908459:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908464:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908469:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908474:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908479:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908503:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908509:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908514:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908519:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908524:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908530:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908535:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908540:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908545:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908550:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908555:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908560:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908565:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908570:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908574:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908579:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908584:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908589:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908595:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908600:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908605:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908610:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908614:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908619:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908624:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908629:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908633:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908637:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908642:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448567.908647:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788448567.910111:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff99a804436600:5851] 1 exiting: rc = 0 00000100:00100000:0.0:1788448567.910604:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff99a804437e00:5850] 0 exiting: rc = 1 00000100:00100000:2.0:1788448567.910763:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff99a804436a00:5852] 2 exiting: rc = 0 00000100:00100000:0.0:1788448567.911920:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911929:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911959:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911965:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911971:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911977:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911982:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911987:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911993:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.911998:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912004:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912009:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912014:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912020:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912026:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912032:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912038:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912043:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912050:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912055:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912062:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912068:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912073:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912078:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912084:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912090:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912120:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912126:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912131:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912137:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912143:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912149:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912202:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912283:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912290:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912296:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912300:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912305:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912310:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912315:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912320:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912326:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912332:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912337:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912343:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912349:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912355:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912360:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912366:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912372:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912392:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912400:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912406:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912413:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912420:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912425:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912431:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912436:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912441:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912446:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912451:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912456:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912461:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448567.912474:0:13021:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788448567.926334:0:13021:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448567.926354:0:13021:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788448567.926361:0:13021:0:(genops.c:885:class_export_put()) final put ffff99a809218800/MDS_uuid 00000020:00000080:0.0:1788448567.926384:0:13021:0:(genops.c:844:class_export_destroy()) destroying export ffff99a809218800/MDS_uuid for MDS 00000020:01000000:0.0:1788448567.926396:0:13021:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788448567.926671:0:13021:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:1.0:1788448568.467114:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448568.467125:0:7637:0:(genops.c:885:class_export_put()) final put ffff99a83fccc000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788448568.467591:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83fccc000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788448568.467638:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a83fcce800 for lustre-OST0001 00010000:00010000:3.0:1788448568.867822:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448569.888349:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788448570.546556:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788448570.546575:0:6707:0:(genops.c:885:class_export_put()) final put ffff99a704c37000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788448570.552472:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704c37000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788448570.552531:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a704c30800 for lustre-OST0000 00010000:00010000:2.0:1788448570.912902:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448571.611473:0:13174:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788448571.628647:0:13174:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788448571.628704:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448571.628806:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448571.628815:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448571.628823:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448571.628848:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788448571.628853:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788448571.628885:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448571.628891:0:13174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788448571.628898:0:13174:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448571.628927:0:13174:0:(import.c:65:import_set_state_nolock()) ffff99a704f19000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:3.0:1788448571.630695:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448571.630707:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448571.630729:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448571.630733:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448571.630743:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448571.630750:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448571.630756:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788448571.630758:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788448571.630761:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788448571.630798:0:5825:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448571.630805:0:5825:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448571.630839:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448571.630846:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842179a00/0xd0e9b344b90aae79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xd0e9b344b90aae80 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448571.630860:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448571.630862:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448571.630864:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448571.630952:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926960000:0@lo:39:umount.0 00000400:00000100:3.0:1788448571.631007:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323926960000 offset 0 length 224: 4 00000100:00100000:0.0:1788448571.631609:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926960128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788448571.631658:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448571.631782:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926960128 00000100:00100000:3.0:1788448571.631799:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926960128 00000100:00100000:3.0:1788448571.631842:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448571.631850:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875323926960128:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1788448571.631856:0:5824:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788448571 with bad export cookie 15053760337206225762 00000100:00100000:2.0:1788448571.647168:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3312:x1875323926960128:12345-0@lo:103:ldlm_bl.0 Request processed in 15305us (15498us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788448571.647219:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:0.0:1788448571.647451:0:3312:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.137@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788448571.647458:0:3312:0:(import.c:65:import_set_state_nolock()) ffff99a809ae4800 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1788448571.647463:0:3312:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.137@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1788448571.662578:0:3312:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.137@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1788448571.662583:0:3312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788448571.662595:0:3312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a83563a300 x1875323926960128/t0(0) o103->MGC192.168.204.137@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788448587 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788448571.662610:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788448571.662613:0:3312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788448571.662614:0:3312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788448571.662618:0:3312:0:(import.c:65:import_set_state_nolock()) ffff99a809ae4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448571.662622:0:3312:0:(import.c:510:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 191 00000100:00080000:0.0:1788448571.662631:0:3312:0:(import.c:624:import_select_connection()) MGC192.168.204.137@tcp: import ffff99a809ae4800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448571.662876:0:3312:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83d2e4e00 x1875323926960256/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448571.662918:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:623f2df2-d49f-4f54-8e7f-befebe2e7643:3312:1875323926960128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448571.662993:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926960256:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:3.0:1788448571.663058:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323926960256 offset 0 length 520: 4 00010000:00010000:0.0:1788448571.936359:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448572.000770:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926960384:0@lo:400:kworker.0 00000400:00000100:2.0:1788448572.000851:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323926960384 offset 0 length 224: 4 00010000:00010000:2.0:1788448572.962700:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448573.984537:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448575.008456:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448576.032761:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448577.058574:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448577.121221:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448577.121234:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788448577.121419:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448577.121442:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926960512:0@lo:400:kworker.0 00000400:00000100:0.0:1788448577.121510:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323926960512 offset 0 length 224: 4 00010000:00010000:0.0:1788448578.081955:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448579.104764:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448580.128506:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448581.152419:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448581.216629:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448571/real 1788448571] req@ffff99a83d2e4e00 x1875323926960256/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448581.216673:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a83d2e4e00 x1875323926960256/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788448581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448581.216685:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448571/real 1788448571] req@ffff99a83d2e5180 x1875323926960000/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448581 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448581.216698:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a83d2e5180 x1875323926960000/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448581 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788448581.216720:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a809ae4800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448581.216749:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788448581.216753:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926960256:0@lo:250:ptlrpcd_00_03.0 00000100:00080000:2.0:1788448581.216760:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a704f19000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788448581.216779:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926960000:0@lo:39:umount.0 00000100:00080000:1.0:1788448581.216913:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788448581.216918:0:13174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788448581.216923:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788448581.218155:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788448581.218165:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788448581.218169:0:36:0:(import.c:65:import_set_state_nolock()) ffff99a809ae4800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448581.218177:0:36:0:(import.c:510:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 432 00000100:00080000:3.0:1788448581.218182:0:36:0:(import.c:589:import_select_connection()) MGC192.168.204.137@tcp: tried all connections, increasing latency to 5s 00010000:00010000:1.0:1788448581.218295:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788448581.218296:0:36:0:(import.c:624:import_select_connection()) MGC192.168.204.137@tcp: import ffff99a809ae4800 using connection 192.168.204.137@tcp/0@lo 00010000:00010000:1.0:1788448581.218322:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218368:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218376:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218404:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448581.218413:0:13174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218421:0:13174:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218427:0:13174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218432:0:13174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448581.218457:0:13174:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788448581.218462:0:13174:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788448581.218493:0:13174:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000100:00100000:3.0:1788448581.218495:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83563bb80 x1875323926960640/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:1.0:1788448581.218500:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788448581.218506:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788448581.218515:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788448581.218521:0:13174:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99a704c58000) has no exports 00000020:00080000:1.0:1788448581.218556:0:13174:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff99a704c58000) has no exports 00000100:00100000:3.0:1788448581.218583:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926960768:0@lo:400:kworker.0 00000400:00000100:3.0:1788448581.218643:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323926960768 offset 0 length 224: 4 00000100:00100000:3.0:1788448581.218959:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926960640:0@lo:250:kworker.0 00000400:00000100:3.0:1788448581.218982:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875323926960640 offset 0 length 520: 4 00010000:00010000:0.0:1788448581.219038:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448581.219057:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219066:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246800 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448581.219071:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219081:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448581.219089:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448581.219095:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788448581.219097:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1788448581.219099:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1788448581.219112:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:0.0:1788448581.219117:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219124:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809246800/0xd0e9b344b90aae87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae8e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219140:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448581.219144:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219149:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809247a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448581.219153:0:5825:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219170:0:5825:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448581.219176:0:5825:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448581.219182:0:5825:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788448581.219234:0:5825:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788448581.219237:0:5825:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788448581.219244:0:5825:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:0.0:1788448581.219247:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219253:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809247a00/0xd0e9b344b90ab0be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90ab0c5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448581.219263:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448581.219265:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448581.219267:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448581.220164:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788448581.227523:0:13174:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a834f354e0 - data ffff99a838fe1510/ffff99a83fcea400 00000020:01000000:1.0:1788448581.227664:0:13174:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a83e6fa180 - data ffff99a838feca20/ffff99a704f13000 00100000:10000000:3.0:1788448581.242994:0:13174:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788448581.270621:0:13174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aac96 00000020:00000080:3.0:1788448581.270633:0:13174:0:(genops.c:885:class_export_put()) final put ffff99a704c63000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788448581.270661:0:13174:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a8092e0800 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788448581.270665:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a8092e0800 2 00000020:01000004:3.0:1788448581.270669:0:13174:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a8092e0800 from lustre-OST0000 00000020:00000080:3.0:1788448581.270691:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448581.270702:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788448581.270705:0:13174:0:(genops.c:885:class_export_put()) final put ffff99a83d439000/lustre-OST0000_UUID 00000020:00000080:3.0:1788448581.270708:0:13174:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d439000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788448581.270715:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:00000080:0.0:1788448581.270860:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704c63000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:3.0:1788448581.270971:0:13174:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788448581.270979:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788448581.270983:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448581.270989:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788448581.270995:0:13174:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff99a704f1e000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788448581.271001:0:13174:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff99a83e70cd28) has exports, disconnecting them 00000020:00080000:3.0:1788448581.271006:0:13174:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff99a704f1e000), last request at 1788448350 00000020:00000080:3.0:1788448581.271010:0:13174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aacc0 00000020:00080000:3.0:1788448581.271021:0:13174:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a704f1e000): rc 0 00000020:00000080:3.0:1788448581.271026:0:13174:0:(genops.c:885:class_export_put()) final put ffff99a704f1e000/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788448581.272589:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704f1e000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788448581.273017:0:13174:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788448581.273023:0:13174:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448581.273028:0:13174:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788448581.273034:0:13174:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788448581.273259:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448581.273269:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1788448581.273277:0:13174:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a8092e0800 1 00000020:00000080:2.0:1788448581.273296:0:13174:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aac50 00000020:00000080:2.0:1788448581.273305:0:13174:0:(genops.c:885:class_export_put()) final put ffff99a8092e3800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788448581.273311:0:13174:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788448581.273317:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448581.273321:0:13174:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788448581.273325:0:13174:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff99a806578000) has no exports 00000020:00000080:0.0:1788448581.273802:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a704f19000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1788448581.273811:0:36:0:(genops.c:885:class_export_put()) final put ffff99a83d43c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:0.0:1788448581.273814:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a83d43c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:0.0:1788448581.273820:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:0.0:1788448581.273889:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8092e3800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788448581.308089:0:13174:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788448581.308111:0:13174:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1788448581.308133:0:13174:0:(genops.c:885:class_export_put()) final put ffff99a8092e4800/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1788448581.308138:0:13174:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8092e4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1788448581.308146:0:13174:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1788448581.308318:0:13174:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a8092e7800 00000020:02000400:0.0:1788448581.308375:0:13174:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788448582.176324:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448583.200494:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448584.225519:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788448584.662143:0:13326:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788448584.692163:0:13326:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1788448584.694327:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448584.694551:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448584.694559:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448584.694585:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448584.694660:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788448584.694666:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788448584.694695:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788448584.694708:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a83d2e7100 x1875323926960384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448588 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448584.694733:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a83563b480 x1875323926960512/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448593 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448584.694743:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a835639180 x1875323926960768/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448597 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448584.694764:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788448584.694780:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788448584.694806:0:13326:0:(import.c:65:import_set_state_nolock()) ffff99a834867800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1788448584.694841:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926960896:0@lo:39:umount.0 00000100:00100000:2.0:1788448584.694986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926960768:0@lo:400:kworker.0 00000100:00100000:0.0:1788448584.695071:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926960512:0@lo:400:kworker.0 00000100:00100000:0.0:1788448584.695080:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926960384:0@lo:400:kworker.0 00000400:00000100:3.0:1788448584.695138:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875323926960896 offset 0 length 224: 4 00010000:00010000:1.0:1788448584.695794:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448584.695804:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448584.695816:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a809246600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:1.0:1788448584.695820:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448584.695830:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788448584.695838:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448584.695843:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788448584.695847:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788448584.695849:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788448584.695865:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:1.0:1788448584.695869:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448584.695949:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809246600/0xd0e9b344b90aae5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae64 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448584.696048:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448584.696052:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448584.696054:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448585.248348:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448586.272450:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788448586.336477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788448586.336487:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1788448587.296362:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448588.321751:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448589.350930:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448590.368745:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448591.392405:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448591.457873:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788448591.457883:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:2.0:1788448592.417338:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448593.440437:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448594.464500:0:5825:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448594.912703:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448584/real 1788448584] req@ffff99a835639500 x1875323926960896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448594 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448594.912738:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a835639500 x1875323926960896/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788448594 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448594.912755:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a834867800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1788448594.912773:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926960896:0@lo:39:umount.0 00000100:00080000:2.0:1788448594.912876:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788448594.912882:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1788448594.912887:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1788448594.914945:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.914963:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.914970:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.914977:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.915008:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448594.915033:0:13326:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.915041:0:13326:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.915048:0:13326:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.915055:0:13326:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448594.915147:0:13326:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1788448594.915153:0:13326:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1788448594.915173:0:13326:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1788448594.915177:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1788448594.915181:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448594.915209:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788448594.915214:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99a806498000) has no exports 00000020:00080000:2.0:1788448594.915248:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff99a806498000) has no exports 00000020:01000000:2.0:1788448594.925062:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a834f35d20 - data ffff99a83fe4abd0/ffff99a83d180400 00000020:01000000:2.0:1788448594.925509:0:13326:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff99a80bbb26c0 - data ffff99a838ffcca8/ffff99a83fce9800 00010000:00010000:3.0:1788448594.926699:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448594.926727:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926740:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448594.926744:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926754:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448594.926761:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448594.926766:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788448594.926769:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788448594.926772:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788448594.926788:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:3.0:1788448594.926792:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926798:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90aae6b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aae72 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926810:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448594.926814:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926820:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448594.926822:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926840:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448594.926846:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448594.926852:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788448594.926854:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788448594.926856:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788448594.926862:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:3.0:1788448594.926864:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926869:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ab0b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90ab0b7 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448594.926882:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448594.926884:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448594.926887:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448594.927067:0:11159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:1.0:1788448594.970810:0:13326:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1788448595.013917:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad61 00000020:00000080:2.0:1788448595.013928:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a835b9c800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1788448595.013951:0:13326:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a80888c000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1788448595.013954:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80888c000 2 00000020:01000004:2.0:1788448595.013957:0:13326:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff99a80888c000 from lustre-OST0001 00000020:00000080:2.0:1788448595.013980:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448595.013990:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1788448595.013993:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a835b98800/lustre-OST0001_UUID 00000020:00000080:2.0:1788448595.013996:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff99a835b98800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1788448595.014015:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1788448595.014094:0:13326:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 623f2df2-d49f-4f54-8e7f-befebe2e7643->MGS 00010000:00010000:2.0:1788448595.014110:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448595.014121:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448595.014128:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1788448595.014130:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1788448595.014133:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1788448595.014148:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:2.0:1788448595.014151:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a800031e00/0xd0e9b344b90aac73 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aac7a expref: -99 pid: 6678 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448595.014167:0:13326:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448595.014172:0:13326:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448595.014176:0:13326:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788448595.014178:0:13326:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1788448595.014180:0:13326:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00000020:00000080:1.0:1788448595.014374:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a835b9c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:2.0:1788448595.014804:0:13326:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff99a809ae4800 00010000:00010000:2.0:1788448595.014808:0:13326:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a809246400/0xd0e9b344b90aaeb1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xd0e9b344b90aaeb8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788448595.014827:0:13326:0:(import.c:65:import_set_state_nolock()) ffff99a809ae4800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1788448595.014832:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788448595.014834:0:13326:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788448595.014846:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788448595.014851:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788448595.014862:0:13326:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff99a83563bb80 x1875323926960640/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788448596 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788448595.014883:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788448595.014887:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 1s for inflight to error out 00000100:00100000:3.0:1788448595.014958:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:623f2df2-d49f-4f54-8e7f-befebe2e7643:3308:1875323926960640:0@lo:250:kworker.0 10000000:01000000:2.0:1788448595.015295:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788448595.015303:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aab54 00000020:00000080:2.0:1788448595.015309:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a80921d000/623f2df2-d49f-4f54-8e7f-befebe2e7643 00000020:01000000:2.0:1788448595.015324:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.137@tcp (flags='') 00000020:00000080:2.0:1788448595.015329:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448595.015337:0:13326:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.137@tcp: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1788448595.015341:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff99a8065799b8) has no exports 10000000:01000000:3.0:1788448595.015386:0:5834:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 00000020:00000080:1.0:1788448595.015464:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a80921d000/623f2df2-d49f-4f54-8e7f-befebe2e7643 for MGC192.168.204.137@tcp 10000000:01000000:2.0:1788448595.015501:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.137@tcp: client import never connected 00000100:00080000:2.0:1788448595.015503:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1788448595.015506:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1788448595.015508:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1788448595.015510:0:13326:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1788448595.015551:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788448595.015557:0:13326:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.137@tcp (uuid 623f2df2-d49f-4f54-8e7f-befebe2e7643) 00000020:01000000:2.0:1788448595.015562:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788448595.015574:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788448595.015578:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788448595.015583:0:13326:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff99a704c36800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788448595.015588:0:13326:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff99a80649b370) has exports, disconnecting them 00000020:00080000:2.0:1788448595.015593:0:13326:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff99a704c36800), last request at 1788448368 00000020:00000080:2.0:1788448595.015597:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad8b 00000020:00080000:2.0:1788448595.015610:0:13326:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff99a704c36800): rc 0 00000020:00000080:2.0:1788448595.015613:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a704c36800/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1788448595.016323:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a809ae4800 for MGC192.168.204.137@tcp 00000020:00000080:1.0:1788448595.016334:0:36:0:(genops.c:885:class_export_put()) final put ffff99a804924800/623f2df2-d49f-4f54-8e7f-befebe2e7643 00000020:00000080:1.0:1788448595.016336:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a804924800/623f2df2-d49f-4f54-8e7f-befebe2e7643 for MGC192.168.204.137@tcp 00000020:01000000:1.0:1788448595.016355:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.137@tcp (623f2df2-d49f-4f54-8e7f-befebe2e7643) 00000020:00000080:1.0:1788448595.016593:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a704c36800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:3.0:1788448595.020873:0:13326:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788448595.020883:0:13326:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788448595.020888:0:13326:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788448595.020896:0:13326:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788448595.021006:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff99a834867800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1788448595.033296:0:5825:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788448595.033686:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1788448595.066521:0:11159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1788448595.066887:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff99a807928600:5820] 0 exiting: rc = 1 00000100:00100000:3.0:1788448595.066971:0:5821:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff99a807928a00:5821] 1 exiting: rc = 0 00000100:00100000:3.0:1788448595.067026:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.067314:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff99a807f8aa00:5824] 2 exiting: rc = 0 00000100:00100000:3.0:1788448595.067392:0:6696:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff99a7047e1e00:6696] 3 exiting: rc = 0 00000100:00100000:1.0:1788448595.067736:0:5822:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff99a807f8a200:5822] 0 exiting: rc = 1 00000100:00100000:1.0:1788448595.069169:0:5823:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff99a807928c00:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1788448595.069473:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069483:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069490:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069496:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069503:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069513:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069521:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069526:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069534:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069540:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069546:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069552:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069558:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069573:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069581:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069587:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069593:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069599:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069605:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069610:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069616:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069621:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069627:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069632:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069637:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069644:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069649:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069655:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069660:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069665:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069670:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069675:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069680:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069685:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069714:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069719:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069724:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069730:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069735:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069741:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069745:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069751:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069756:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069761:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069765:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069770:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069774:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069779:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069783:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069789:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069794:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069800:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069805:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.069810:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070097:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070103:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070316:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070501:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070512:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070516:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070524:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070529:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070535:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.070540:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788448595.076969:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448595.076984:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788448595.076990:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a835b9b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788448595.076997:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff99a835b9b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788448595.077003:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1788448595.077068:0:13326:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a80888c000 1 00000020:00000080:3.0:1788448595.077074:0:13326:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xd0e9b344b90aad30 00000020:00000080:3.0:1788448595.077081:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a808888800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788448595.077101:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788448595.077106:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448595.077111:0:13326:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788448595.077116:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff99a8075eb370) has no exports 00000020:00000080:1.0:1788448595.077599:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff99a808888800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788448595.094362:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448595.094380:0:13326:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1788448595.094387:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a808889000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1788448595.094392:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff99a808889000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1788448595.094404:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1788448595.094644:0:13326:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff99a808889800 00000020:01000000:3.0:1788448595.094670:0:13326:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1788448595.094675:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788448595.094741:0:13326:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788448595.094746:0:13326:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff99a80657b370) has no exports 00000020:00000080:3.0:1788448595.094775:0:13326:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788448595.094784:0:13326:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1788448595.094787:0:13326:0:(genops.c:885:class_export_put()) final put ffff99a8092e6000/OSS_uuid 00000020:00000080:3.0:1788448595.094790:0:13326:0:(genops.c:844:class_export_destroy()) destroying export ffff99a8092e6000/OSS_uuid for OSS 00000020:01000000:3.0:1788448595.094794:0:13326:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1788448595.095039:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff99a8078a4c00:6682] 1 exiting: rc = 0 00000100:00100000:3.0:1788448595.095144:0:12065:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff99a8355f2800:12065] 3 exiting: rc = 0 00000100:00100000:3.0:1788448595.099287:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff99a8348b0a00:6683] 2 exiting: rc = 0 00000100:00100000:2.0:1788448595.099824:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff99a8078a5000:6680] 0 exiting: rc = 1 00000100:00100000:3.0:1788448595.101215:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101228:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101761:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101772:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101777:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101783:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101789:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101794:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101814:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101820:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101825:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101831:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101836:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101842:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101848:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101854:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101859:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101865:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101871:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101877:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101883:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101890:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101896:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101901:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101906:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101912:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101918:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101924:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101932:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101938:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101944:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101952:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101959:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101965:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101969:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.101975:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00080000:1.0:1788448595.102798:0:5833:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1788448595.103920:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103940:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103946:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103951:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103957:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103962:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103967:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103989:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.103994:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104000:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104005:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104009:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104014:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104020:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104026:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104031:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104040:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104046:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104050:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104055:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104061:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104066:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104071:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104076:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104081:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104086:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104091:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.104106:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.105519:0:8106:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff99a834f33200:8106] 2 exiting: rc = 0 00000100:00100000:3.0:1788448595.105628:0:6685:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff99a808790200:6685] 1 exiting: rc = 0 00000100:00100000:0.0:1788448595.106988:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff99a808790a00:6684] 0 exiting: rc = 1 00000100:00100000:3.0:1788448595.107218:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107228:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107234:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107239:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107244:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107249:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107253:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107259:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107264:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107270:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107276:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107281:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107300:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107305:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107309:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107315:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107320:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107325:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107332:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107337:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107342:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107346:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107351:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107356:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107361:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107366:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107372:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107378:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107383:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107388:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107393:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107398:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107403:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107408:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107413:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107418:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107423:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107428:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107434:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107439:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107445:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107452:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107458:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107463:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107468:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107473:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107478:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107491:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107495:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107501:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107507:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107513:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107519:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107524:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107529:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107535:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107540:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107546:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107551:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107556:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107562:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107577:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107583:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.107589:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.112410:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff99a80ba8be00:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1788448595.112704:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff99a80bdbc600:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1788448595.112936:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff99a807928e00:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1788448595.113151:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113160:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113166:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113172:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113179:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113209:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113217:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113224:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113230:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113246:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113255:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113262:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113268:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113273:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113279:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113284:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113291:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113297:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113322:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113328:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113335:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113341:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113347:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113353:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113360:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113366:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113372:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113377:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113382:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113387:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113392:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113397:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113403:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113422:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113428:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113434:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113439:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113445:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113450:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113456:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113462:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113468:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113474:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113480:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113486:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113491:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113497:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113503:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113509:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113514:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113520:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113525:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113531:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113543:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113549:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113554:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113560:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113580:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113601:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113608:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113614:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113619:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113624:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.113630:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788448595.127838:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff99a804452400:6690] 1 exiting: rc = 0 00000100:00100000:3.0:1788448595.128780:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff99a80792fe00:6689] 0 exiting: rc = 1 00000100:00100000:1.0:1788448595.135476:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135487:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135492:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135497:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135502:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135507:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135512:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.135516:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.136968:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137003:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137009:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137015:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137020:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137026:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137031:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137036:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137042:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137049:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137054:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137059:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137066:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137071:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137076:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137081:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137103:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137108:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137114:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137120:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137125:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137131:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137136:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137141:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137146:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137151:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137156:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137161:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137167:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137172:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137177:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137209:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137216:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137221:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137226:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137232:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137237:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137242:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137247:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137253:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137258:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137263:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137268:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137273:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137278:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137282:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137287:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137292:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137296:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137302:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137307:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137321:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137326:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137332:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137338:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788448595.137343:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.140288:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff99a809992400:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1788448595.141410:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff99a804854a00:6692] 1 exiting: rc = 0 00000100:00100000:3.0:1788448595.141536:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141547:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141555:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141561:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141577:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141599:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141606:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141614:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141620:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141626:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141634:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141640:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141645:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141651:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141658:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141664:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141698:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141721:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141729:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141735:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141740:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141746:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141753:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141759:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141765:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141772:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141778:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141784:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141792:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141812:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141823:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141831:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141838:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141845:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141852:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141858:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141865:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141871:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141878:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141884:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141890:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141910:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141917:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141924:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141932:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141939:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141947:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141954:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141960:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141966:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.141974:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142140:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142147:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142169:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142177:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142217:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142225:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142231:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142379:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142385:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142391:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142397:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142405:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788448595.142411:0:13326:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788448595.163804:0:13326:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1788448615.656557:0:13943:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1788448625.422799:0:14403:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448625.422806:0:14403:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1788448625.424212:0:14403:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a70705f000 00000020:01000004:3.0:1788448625.424234:0:14403:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1788448625.424243:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788448625.424258:0:14403:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff99a83e70b370) 00000020:00000080:3.0:1788448625.424271:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788448625.454666:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788448625.459067:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1788448625.459708:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:2.0:1788448625.459947:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:2.0:1788448625.460064:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 451: rc = 0 00100000:10000000:2.0:1788448625.460339:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 451: rc = 0 00100000:10000000:2.0:1788448625.460704:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788448625.460918:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 451: rc = 0 00100000:10000000:2.0:1788448625.461030:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:2.0:1788448625.461386:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 453: rc = 0 00100000:10000000:2.0:1788448625.463233:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 644: rc = 0 00100000:10000000:2.0:1788448625.463344:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 644: rc = 0 00100000:10000000:2.0:1788448625.464390:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.464960:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 154: rc = 0 00100000:10000000:2.0:1788448625.465634:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 154: rc = 0 00100000:10000000:2.0:1788448625.466164:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.466651:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 154: rc = 0 00100000:10000000:2.0:1788448625.467179:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.467713:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.468384:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 154: rc = 0 00100000:10000000:2.0:1788448625.470952:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.471492:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 154: rc = 0 00100000:10000000:2.0:1788448625.472014:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 154: rc = 0 00100000:10000000:2.0:1788448625.472614:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 154: rc = 0 00100000:10000000:2.0:1788448625.474321:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 658: rc = 0 00100000:10000000:2.0:1788448625.475362:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 658: rc = 0 00100000:10000000:2.0:1788448625.477348:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 658: rc = 0 00100000:10000000:2.0:1788448625.478663:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 658: rc = 0 00100000:10000000:3.0:1788448625.484358:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 658: rc = 0 00100000:10000000:3.0:1788448625.486081:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 658: rc = 0 00100000:10000000:3.0:1788448625.488693:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 658: rc = 0 00100000:10000000:3.0:1788448625.489066:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 658: rc = 0 00100000:10000000:3.0:1788448625.489378:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 658: rc = 0 00100000:10000000:3.0:1788448625.492283:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 658: rc = 0 00100000:10000000:3.0:1788448625.493022:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 658: rc = 0 00100000:10000000:3.0:1788448625.493370:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 658: rc = 0 00100000:10000000:3.0:1788448625.493816:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 658: rc = 0 00100000:10000000:3.0:1788448625.494101:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 658: rc = 0 00100000:10000000:3.0:1788448625.494403:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 658: rc = 0 00100000:10000000:3.0:1788448625.495753:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 658: rc = 0 00100000:10000000:3.0:1788448625.496481:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 658: rc = 0 00100000:10000000:3.0:1788448625.498353:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 658: rc = 0 00100000:10000000:3.0:1788448625.500303:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 658: rc = 0 00100000:10000000:3.0:1788448625.500908:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 658: rc = 0 00100000:10000000:3.0:1788448625.501412:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 658: rc = 0 00100000:10000000:3.0:1788448625.501731:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 658: rc = 0 00100000:10000000:3.0:1788448625.504420:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 658: rc = 0 00100000:10000000:3.0:1788448625.505468:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 658: rc = 0 00100000:10000000:3.0:1788448625.506996:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 658: rc = 0 00100000:10000000:3.0:1788448625.507313:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 658: rc = 0 00100000:10000000:3.0:1788448625.507992:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 658: rc = 0 00100000:10000000:3.0:1788448625.508638:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 658: rc = 0 00100000:10000000:3.0:1788448625.509233:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 658: rc = 0 00100000:10000000:3.0:1788448625.509643:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 658: rc = 0 00100000:10000000:3.0:1788448625.510051:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 658: rc = 0 00100000:10000000:2.0:1788448625.510935:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 658: rc = 0 00100000:10000000:2.0:1788448625.512700:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 594: rc = 0 00100000:10000000:2.0:1788448625.513724:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1788448625.515162:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 645: rc = 0 00100000:10000000:2.0:1788448625.516647:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1788448625.516757:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 645: rc = 0 00100000:10000000:2.0:1788448625.517449:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1788448625.517961:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 645: rc = 0 00100000:10000000:2.0:1788448625.518409:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1788448625.518500:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 377: rc = 0 00100000:10000000:2.0:1788448625.519262:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1788448625.519342:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 377: rc = 0 00100000:10000000:2.0:1788448625.520062:0:14403:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1788448625.520680:0:14403:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 377: rc = 0 00000020:00000080:2.0:1788448625.521643:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1788448625.521653:0:14403:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788448625.521666:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abe55 00000020:01000004:2.0:1788448625.521675:0:14403:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1788448625.521681:0:14403:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1788448625.521699:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a70705f000 from MGS 00000020:01000004:2.0:1788448625.521704:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1788448625.521717:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff99a806498000) 00000020:00000080:2.0:1788448625.521730:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1788448625.521934:0:14403:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a70705f000 from MGS, refs=2 00080000:01000000:2.0:1788448625.521940:0:14403:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448625.521946:0:14403:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abe63 00000100:00100000:2.0:1788448625.522315:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1788448625.522630:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1788448625.522644:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1788448625.524669:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1788448625.524683:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1788448625.525668:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448625.526311:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1788448625.526319:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1788448625.527358:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1788448625.527368:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1788448625.527939:0:14403:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1788448625.527946:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788448625.529666:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448625.529671:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448625.529674:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448625.530071:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448625.530074:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448625.530076:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448625.531326:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788448625.534941:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788448625.547966:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1788448625.547998:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1788448625.548002:0:14403:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1788448625.550101:0:14412:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788448625.550275:0:14403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788448625.550371:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788448625.551023:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788448625.551363:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448625.551619:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788448625.551626:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788448625.552718:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788448625.552727:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1788448625.553290:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1788448625.553297:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000100:00080000:0.0:1788448625.554623:0:14416:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000020:00000080:3.0:1788448625.555273:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1788448625.555297:0:14403:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.137@tcp' 00000020:01000004:3.0:1788448625.555300:0:14403:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1788448625.555342:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.137@tcp (typ=mgc) 00000020:00000080:3.0:1788448625.555356:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.137@tcp (ffff99a83e70cd28) 00000020:00000080:3.0:1788448625.555371:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1788448625.555452:0:14403:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a82ea15000@MGC192.168.204.137@tcp: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448625.556060:0:14403:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.137@tcp-0 is initialized 00000040:01000000:3.0:1788448625.556068:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 1 is initialized 10000000:01000000:0.0:1788448625.562932:0:14417:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1788448625.566009:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.137@tcp (uuid 5961e328-478c-41d0-979d-0dab1f06ac13) 00000020:00000080:3.0:1788448625.566040:0:14403:0:(genops.c:1385:class_connect()) connect: client 5961e328-478c-41d0-979d-0dab1f06ac13, cookie 0xd0e9b344b90abe71 00000100:00080000:3.0:1788448625.566054:0:14403:0:(import.c:510:import_select_connection()) MGC192.168.204.137@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448625.566062:0:14403:0:(import.c:624:import_select_connection()) MGC192.168.204.137@tcp: import ffff99a82ea15000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448625.566597:0:14403:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a835638380 x1875323926961024/t0(0) o250->MGC192.168.204.137@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448625.566642:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5961e328-478c-41d0-979d-0dab1f06ac13:3308:1875323926961024:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1788448625.566716:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788448625.566823:0:14403:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5961e328-478c-41d0-979d-0dab1f06ac13->MGS 00000020:01000004:3.0:1788448625.566855:0:14403:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1788448625.566878:0:14403:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1788448625.566893:0:14403:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff99a83e7099b8) 00000020:00000080:3.0:1788448625.566907:0:14403:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788448625.571374:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961024 00000100:00100000:1.0:1788448625.571390:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961024 00000100:00100000:1.0:1788448625.571438:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448625.571447:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3308:x1875323926961024:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788448625.571474:0:14413:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5961e328-478c-41d0-979d-0dab1f06ac13@0@lo t0 exp 0000000000000000 cur 486 last 0 00000020:00000080:1.0:1788448625.571828:0:14413:0:(genops.c:1385:class_connect()) connect: client 5961e328-478c-41d0-979d-0dab1f06ac13, cookie 0xd0e9b344b90abe7f 00000100:00080000:1.0:1788448625.572062:0:14413:0:(import.c:65:import_set_state_nolock()) ffff99a83d38b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448625.573370:0:3308:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.204.137@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1788448625.573387:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.137@tcp: connect to target with instance 0 00000100:00080000:3.0:1788448625.573395:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.137@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1788448625.573400:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1788448625.573405:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a82ea15000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1788448625.573408:0:3308:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1788448625.573418:0:3308:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1788448625.573426:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5961e328-478c-41d0-979d-0dab1f06ac13:3308:1875323926961024:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788448625.573596:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+5:3308:x1875323926961024:12345-0@lo:250:mount.lustre.0 Request processed in 1642us (6372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.573608:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448625.581160:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448625.581379:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788448625.581400:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788448625.583989:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788448625.584005:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1788448625.585321:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1788448625.585332:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788448625.587493:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448625.588652:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788448625.588661:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1788448625.591935:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1788448625.591946:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1788448625.649506:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448625.649733:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1788448625.649748:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788448625.656854:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788448625.656873:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788448625.657793:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448625.658042:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448625.658048:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788448625.658648:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788448625.658657:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1788448625.667516:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448625.667743:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1788448625.667750:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788448625.670594:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788448625.670609:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788448625.671275:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788448625.671469:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788448625.671475:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1788448625.671915:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788448625.671922:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788448625.698089:0:14403:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788448625.698450:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788448625.698461:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788448625.700663:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788448625.700678:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1788448625.701727:0:14403:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788448625.701740:0:14403:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788448625.703338:0:14403:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788448625.703373:0:14403:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1788448625.703383:0:14403:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788448625.703574:0:14403:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448625.703625:0:14403:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788448625.703631:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448625.703633:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448625.703634:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448625.703636:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448625.703637:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448625.703638:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448625.703640:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448625.703641:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448625.703643:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448625.703644:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448625.703647:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788448625.703649:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448625.703650:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448625.703651:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448625.703652:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448625.703653:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448625.703655:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448625.703656:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448625.703657:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448625.703658:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448625.703659:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448625.703691:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788448625.703714:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961152:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448625.703806:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.703921:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcf000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.704485:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961152 00000100:00100000:0.0:1788448625.704495:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961152 00000100:00100000:0.0:1788448625.704579:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448625.704589:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+5:14403:x1875323926961152:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448625.704640:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788448625.704644:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788448625.704647:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788448625.705017:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788448625.705517:0:14415:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1788448625.707834:0:14437:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1788448625.707842:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1788448625.707845:0:14437:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1788448625.707881:0:14437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1788448625.708569:0:14415:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788448625.708580:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788448625.720895:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+5:14403:x1875323926961152:12345-0@lo:253:mount.lustre.0 Request processed in 16296us (17078us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.720911:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448625.721040:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961152:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448625.721059:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788448625.721063:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448625.721065:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448625.721066:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448625.721067:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448625.721069:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448625.721099:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448625.721100:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448625.721102:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448625.721103:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448625.721105:0:14403:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448625.721126:0:14403:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a70705f000 from lustre-MDT0000 10000000:01000000:2.0:1788448625.721157:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788448625.721160:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788448625.721166:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff99a83e70cd28 10000000:01000000:2.0:1788448625.721173:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448625.721207:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff99a83e70cd28 from 1 10000000:01000000:2.0:1788448625.721211:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788448625.721257:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.721269:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.721278:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.721298:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448625.721334:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.721374:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.721488:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961280 00000100:00100000:1.0:1788448625.721495:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961280 00000100:00100000:1.0:1788448625.721538:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448625.721546:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+5:14403:x1875323926961280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448625.721559:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448625.721573:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90abe8d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abe86 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.721606:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90abe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abe86 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.721617:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9c200/0xd0e9b344b90abe8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abe86 expref: 6 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.721626:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c200, rc 0) 00000100:00100000:1.0:1788448625.721666:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+6:14403:x1875323926961280:12345-0@lo:101:mount.lustre.0 Request processed in 121us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.721673:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448625.721783:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448625.721797:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.721807:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.721855:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961408:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448625.721885:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.721907:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.721959:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961408 00000100:00100000:1.0:1788448625.721964:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961408 00000100:00100000:1.0:1788448625.722037:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448625.722045:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+6:14403:x1875323926961408:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448625.722320:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+6:14403:x1875323926961408:12345-0@lo:501:mount.lustre.0 Request processed in 275us (433us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448625.722327:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448625.722391:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961408:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448625.722415:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788448625.722434:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.722442:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448625.722452:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a70705f000 10000000:01000000:2.0:1788448625.722456:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448625.722460:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff99a70705f000 10000000:01000000:2.0:1788448625.722463:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788448625.722466:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff99a70705f000 from 1 10000000:01000000:2.0:1788448625.722469:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788448625.722486:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.722493:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.722500:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.722512:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961536:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448625.722538:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.727349:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.730460:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961536 00000100:00100000:0.0:1788448625.730483:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961536 00000100:00100000:0.0:1788448625.730565:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448625.730578:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+6:14403:x1875323926961536:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448625.730599:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448625.730632:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810758600/0xd0e9b344b90abe9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abe94 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.730661:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810758600/0xd0e9b344b90abe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abe94 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.730672:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810758600/0xd0e9b344b90abe9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abe94 expref: 7 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.730682:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758600, rc 0) 00000100:00100000:0.0:1788448625.730772:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+7:14403:x1875323926961536:12345-0@lo:101:mount.lustre.0 Request processed in 197us (8233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.730780:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448625.730962:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961536:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448625.731008:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe9b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.731018:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abe9b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448625.731041:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788448625.731062:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe9b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.731069:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628000/0xd0e9b344b90abe94 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe9b expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448625.731078:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788448625.731094:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448625.731100:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff99a70705f000 10000000:01000000:2.0:1788448625.731103:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788448625.731107:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788448625.731110:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448625.731137:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.731146:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.731156:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.731181:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961664:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448625.731252:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.731270:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806dcfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.732570:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961664 00000100:00100000:1.0:1788448625.732582:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961664 00000100:00100000:2.0:1788448625.734344:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788448625.734357:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+7:14403:x1875323926961664:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448625.734376:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448625.734398:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810628e00/0xd0e9b344b90abea9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abea2 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.734428:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810628e00/0xd0e9b344b90abea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abea2 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.734440:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810628e00/0xd0e9b344b90abea9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abea2 expref: 8 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.734449:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810628e00, rc 0) 00000100:00100000:2.0:1788448625.734547:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+8:14403:x1875323926961664:12345-0@lo:101:mount.lustre.0 Request processed in 192us (3294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.734554:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448625.734730:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448625.734752:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abea9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.734764:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abea9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448625.734840:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448625.734891:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448625.734930:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed49c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448625.734993:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961792 00000100:00100000:2.0:1788448625.734999:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961792 00000100:00100000:2.0:1788448625.735030:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788448625.735038:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+8:14403:x1875323926961792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448625.735546:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+9:14403:x1875323926961792:12345-0@lo:501:mount.lustre.0 Request processed in 508us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.735554:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448625.736245:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448625.736297:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448625.736350:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448625.736379:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.736469:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926961920 00000100:00100000:0.0:1788448625.736475:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926961920 00000100:00100000:0.0:1788448625.736509:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788448625.736523:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+9:14403:x1875323926961920:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448625.736841:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+9:14403:x1875323926961920:12345-0@lo:503:mount.lustre.0 Request processed in 318us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.736850:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448625.736953:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926961920:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448625.737925:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14438:1875323926962048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448625.737996:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.738079:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809acc780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.742733:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962048 00000100:00100000:0.0:1788448625.742749:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962048 00000100:00100000:0.0:1788448625.742859:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788448625.742871:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+9:14438:x1875323926962048:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448625.745512:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+9:14438:x1875323926962048:12345-0@lo:502:llog_process_th.0 Request processed in 2634us (7507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.745528:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448625.745719:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14438:1875323926962048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788448625.745759:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448625.745771:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.745774:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448625.745780:0:14438:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788448625.745791:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448625.745808:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff99a83e708000) 00000020:00000080:3.0:1788448625.745828:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788448625.745835:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788448625.745917:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788448625.745925:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abeb7 00000020:00000080:3.0:1788448625.746176:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788448625.746181:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448625.746206:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.746208:0:14438:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788448625.746211:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448625.746215:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.746216:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788448625.746220:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448625.746235:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff99a82eae99b8) 00000020:00000080:3.0:1788448625.746246:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788448625.746251:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788448625.746253:0:14438:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788448625.746257:0:14438:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788448625.746263:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788448625.746304:0:14438:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a70705f000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788448625.746318:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff99a82eaecd28) 00000020:00000080:3.0:1788448625.746326:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788448625.746380:0:14438:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788448625.746386:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90abecc 00000020:00000080:3.0:1788448625.746472:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788448625.746479:0:14438:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788448625.746484:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xd0e9b344b90abed3 00080000:01000000:3.0:1788448625.746489:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788448625.746491:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abeda 00010000:00010000:2.0:1788448625.834790:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1788448625.836112:0:14438:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:2.0:1788448625.836723:0:14438:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788448625.837379:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff99a8064999b8) 00000020:00000080:2.0:1788448625.837401:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788448625.837494:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788448625.837502:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abee8 00000020:00000080:0.0:1788448625.840627:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1788448625.854719:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xd0e9b344b90abeef 00000020:00000080:3.0:1788448625.855721:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1788448625.855735:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448625.855741:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.855749:0:14438:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1788448625.855753:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448625.855756:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:3.0:1788448625.855757:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448625.855759:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448625.855761:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448625.855763:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.855765:0:14438:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448625.855767:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788448625.855772:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.855774:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1788448625.855778:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1788448625.855819:0:14438:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1788448625.855832:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448625.855835:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.855837:0:14438:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1788448625.855839:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448625.855843:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788448625.855846:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.855848:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788448625.855850:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448625.855855:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:3.0:1788448625.855899:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788448625.855903:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448625.855917:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff99a82eae8000) 00000020:00000080:3.0:1788448625.855934:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1788448625.855939:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448625.856006:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788448625.856013:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:3.0:1788448625.856019:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abefd 00010000:00080000:3.0:1788448625.856051:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a83fc68000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448625.856305:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1788448625.857075:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788448625.857316:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788448625.866668:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448625.866793:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1788448625.866889:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788448625.870802:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448625.870810:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1788448625.872349:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788448625.872364:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788448625.872401:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788448625.872423:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90abf04 00000100:00080000:3.0:1788448625.872438:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448625.872445:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a83fc68000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448625.872498:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a835638380 x1875323926962176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448625.872898:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926962176:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448625.873041:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323926962176 offset 0 length 520: 4 00000100:00080000:3.0:1788448625.873105:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788448625.873180:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788448625.873209:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.873211:0:14438:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788448625.873215:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788448625.873218:0:14438:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:3.0:1788448625.873219:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448625.873221:0:14438:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788448625.873223:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788448625.873225:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.873226:0:14438:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788448625.873229:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788448625.873233:0:14438:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1788448625.873236:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788448625.873237:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788448625.873240:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788448625.873243:0:14438:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.137@tcp to nid 0x20000c0a8cc89 (192.168.204.137@tcp) 00000020:01000000:3.0:1788448625.873266:0:14438:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788448625.873268:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788448625.873294:0:14438:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff99a82eaeb370) 00000020:00000080:3.0:1788448625.873308:0:14438:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788448625.873314:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788448625.873383:0:14438:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788448625.873388:0:14438:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788448625.873395:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xd0e9b344b90abf12 00010000:00080000:3.0:1788448625.873421:0:14438:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a829498800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448625.874120:0:14438:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1788448625.874357:0:14438:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788448625.874377:0:14438:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788448625.879836:0:14438:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448625.880000:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1788448625.880110:0:14438:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1788448625.881332:0:14444:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788448625.881338:0:14444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788448625.882398:0:14438:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788448625.882412:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788448625.882456:0:14438:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788448625.882475:0:14438:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90abf19 00000100:00080000:1.0:1788448625.882485:0:14438:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448625.882491:0:14438:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448625.882698:0:14438:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83d2e7b80 x1875323926962304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448625.882727:0:14438:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1788448625.882800:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926962304:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1788448625.882858:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323926962304 offset 0 length 520: 4 00000020:01000000:1.0:1788448625.883075:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448625.883080:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448625.883082:0:14438:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788448625.883086:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448625.883090:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448625.883092:0:14438:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448625.883095:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448625.883097:0:14438:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448625.883099:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448625.883102:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448625.883103:0:14438:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448625.883118:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448625.883121:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448625.883122:0:14438:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448625.883125:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788448625.883157:0:14438:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14438:1875323926962432:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448625.883237:0:14438:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448625.883260:0:14438:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4480 going to sleep for 11 seconds 00000100:00100000:2.0:1788448625.887483:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962432 00000100:00100000:2.0:1788448625.887499:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962432 00000100:00100000:2.0:1788448625.887569:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448625.887580:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+9:14438:x1875323926962432:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448625.887887:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+9:14438:x1875323926962432:12345-0@lo:502:llog_process_th.0 Request processed in 308us (4650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.887895:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448625.887985:0:14438:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14438:1875323926962432:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788448625.888020:0:14438:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448625.888028:0:14438:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448625.888031:0:14438:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448625.888039:0:14438:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1788448625.888285:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1788448625.888304:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788448625.888321:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abea9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.888332:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628c00/0xd0e9b344b90abea2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abea9 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448625.888340:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a70705f000 from 1 10000000:01000000:2.0:1788448625.888343:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448625.888375:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.888383:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.888392:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.888422:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448625.888459:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.888490:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.888493:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962560 00000100:00100000:0.0:1788448625.888498:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962560 00000100:00100000:0.0:1788448625.888541:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448625.888549:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+9:14403:x1875323926962560:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448625.888558:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448625.888571:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf20 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.888594:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.888616:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448625.888626:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758200, rc 0) 00000100:00100000:0.0:1788448625.888665:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+10:14403:x1875323926962560:12345-0@lo:101:mount.lustre.0 Request processed in 116us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448625.888671:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788448625.891929:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448625.891960:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.891985:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.893412:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962688:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788448625.893501:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.893567:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962688 00000100:00100000:3.0:1788448625.893576:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962688 00000100:00100000:3.0:1788448625.893627:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448625.893638:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+10:14403:x1875323926962688:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788448625.893658:0:14414:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788448625.893664:0:14414:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788448625.893733:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+10:14403:x1875323926962688:12345-0@lo:256:mount.lustre.0 Request processed in 97us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.893741:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448625.893787:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448625.893808:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962688:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788448625.894927:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788448625.894955:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.894976:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448625.894985:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a70705f000 from 1 10000000:01000000:2.0:1788448625.894988:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448625.895024:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.895048:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.895058:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448625.895076:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962816:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448625.895358:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.895396:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.895415:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962816 00000100:00100000:1.0:1788448625.895422:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962816 00000100:00100000:1.0:1788448625.895475:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448625.895484:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+10:14403:x1875323926962816:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448625.895496:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448625.895509:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf2e expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.895688:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.895701:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448625.895710:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9c600, rc 0) 00000100:00100000:1.0:1788448625.895758:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926962816:12345-0@lo:101:mount.lustre.0 Request processed in 274us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.895778:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788448625.895877:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962816:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448625.895891:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.895911:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448625.895993:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448625.896022:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.896034:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a804626a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.896151:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926962944 00000100:00100000:0.0:1788448625.896157:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926962944 00000100:00100000:0.0:1788448625.896228:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788448625.896237:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926962944:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448625.897084:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926962944:12345-0@lo:501:mount.lustre.0 Request processed in 845us (1056us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.897094:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448625.897174:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926962944:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448625.897274:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963072:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448625.897314:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.897373:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a804626a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.899761:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963072 00000100:00100000:1.0:1788448625.899778:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963072 00000100:00100000:1.0:1788448625.899849:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448625.899859:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926963072:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448625.900264:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926963072:12345-0@lo:503:mount.lustre.0 Request processed in 405us (2948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.900273:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448625.900396:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963072:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448625.901115:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14446:1875323926963200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448625.901167:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448625.901234:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8092a4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788448625.901341:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963200 00000100:00100000:1.0:1788448625.901358:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963200 00000100:00100000:1.0:1788448625.901421:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448625.901432:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14446:x1875323926963200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788448625.902041:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14446:x1875323926963200:12345-0@lo:502:llog_process_th.0 Request processed in 611us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448625.902051:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448625.902221:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14446:1875323926963200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788448625.902251:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448625.902261:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448625.902263:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788448625.902272:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a70705f000 00000020:00000080:0.0:1788448625.902275:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448625.902283:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448625.902286:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448625.902287:0:14446:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788448625.902290:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448625.902292:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448625.902300:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448625.902306:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a70705f000 00000020:00000080:0.0:1788448625.902308:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448625.902367:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448625.902370:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448625.902372:0:14446:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788448625.902374:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448625.902376:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448625.902378:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448625.902381:0:14446:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a70705f000 00000020:00000080:0.0:1788448625.902383:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788448625.902420:0:14446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14446:1875323926963328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448625.902592:0:14446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448625.902680:0:14446:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8092a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448625.909829:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963328 00000100:00100000:3.0:1788448625.909849:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963328 00000100:00100000:2.0:1788448625.927886:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448625.927916:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14446:x1875323926963328:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448625.928381:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14446:x1875323926963328:12345-0@lo:502:llog_process_th.0 Request processed in 480us (25788us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.928390:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448625.936675:0:14446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14446:1875323926963328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788448625.936729:0:14446:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448625.936738:0:14446:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448625.936741:0:14446:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1788448625.936746:0:14446:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1788448625.939037:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1788448625.939076:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448625.939164:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.939209:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448625.939275:0:14403:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788448625.939278:0:14403:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a70705f000 10000000:01000000:3.0:1788448625.939281:0:14403:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a70705f000 10000000:01000000:3.0:1788448625.939285:0:14403:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788448625.939301:0:14403:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a70705f000 from 1 10000000:01000000:3.0:1788448625.939304:0:14403:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788448625.939375:0:14403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.939399:0:14403:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.939438:0:14403:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448625.939491:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963456:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448625.943757:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.943813:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448625.943852:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963456 00000100:00100000:3.0:1788448625.943863:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963456 00000100:00100000:3.0:1788448625.944000:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448625.944011:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926963456:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448625.944030:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448625.944052:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc39a00/0xd0e9b344b90abf43 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf3c expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.944081:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc39a00/0xd0e9b344b90abf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf3c expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.944094:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc39a00/0xd0e9b344b90abf43 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf3c expref: 12 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.944104:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39a00, rc 0) 00000100:00100000:3.0:1788448625.944146:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926963456:12345-0@lo:101:mount.lustre.0 Request processed in 137us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.944152:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788448625.944228:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963456:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448625.944252:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf43 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448625.944280:0:14403:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abf43 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448625.944354:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448625.944386:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.944404:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448625.944420:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963584 00000100:00100000:3.0:1788448625.944424:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963584 00000100:00100000:3.0:1788448625.944450:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448625.944456:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926963584:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448625.944823:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926963584:12345-0@lo:501:mount.lustre.0 Request processed in 365us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.944830:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448625.944868:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963584:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448625.944898:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963712:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448625.944952:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448625.944964:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448625.944988:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963712 00000100:00100000:3.0:1788448625.944992:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963712 00000100:00100000:3.0:1788448625.945011:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448625.945016:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926963712:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448625.945151:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926963712:12345-0@lo:503:mount.lustre.0 Request processed in 133us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.945159:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788448625.945226:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926963712:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448625.952996:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14451:1875323926963840:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448625.953100:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448625.953152:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a570c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448625.953338:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963840 00000100:00100000:3.0:1788448625.953347:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963840 00000100:00100000:3.0:1788448625.953393:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788448625.953404:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14451:x1875323926963840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788448625.953725:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14451:x1875323926963840:12345-0@lo:502:llog_process_th.0 Request processed in 321us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448625.953734:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788448625.954208:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14451:1875323926963840:0@lo:502:llog_process_th.0 00000020:01000004:0.0:1788448625.954276:0:14451:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1788448625.954291:0:14451:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff99a8075ecd28) 00000020:00000080:0.0:1788448625.954310:0:14451:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:0.0:1788448625.954386:0:14451:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a70705f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448625.954391:0:14451:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a70705f000 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1788448625.954394:0:14451:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a70705f000 4 00010000:00080000:0.0:1788448625.954423:0:14451:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a80579d000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1788448625.956112:0:14451:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1788448625.963085:0:14451:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1788448625.963141:0:14451:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788448625.963157:0:14451:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xd0e9b344b90abf51 00000100:00080000:1.0:1788448625.963170:0:14451:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788448625.963177:0:14451:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99a80579d000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448625.963239:0:14451:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83d2e6300 x1875323926963968/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788448625.963266:0:14451:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788448625.963739:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926963968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448625.963821:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.968723:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926963968 00000100:00100000:2.0:1788448625.968740:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926963968 00000100:00100000:2.0:1788448625.968792:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448625.968803:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875323926963968:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448625.969082:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875323926963968:12345-0@lo:38:llog_process_th.0 Request processed in 279us (5260us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788448625.969090:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448625.969168:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448625.969178:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a80579d000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448625.969245:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788448625.969250:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926963968:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448625.975317:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14451:1875323926964096:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788448625.975408:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448625.975449:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80469ad80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448625.978492:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964096 00000100:00100000:2.0:1788448625.978507:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964096 00000100:00100000:2.0:1788448625.978586:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788448625.978598:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:14451:x1875323926964096:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788448625.979126:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:14451:x1875323926964096:12345-0@lo:502:llog_process_th.0 Request processed in 527us (3715us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448625.979135:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788448625.983265:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5961e328-478c-41d0-979d-0dab1f06ac13:14451:1875323926964096:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788448625.983313:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1788448625.987076:0:14403:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1788448625.987119:0:14403:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788448625.987139:0:14403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf43 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448625.987153:0:14403:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a83fc39800/0xd0e9b344b90abf3c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf43 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788448625.987245:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788448625.987248:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448625.987249:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448625.987250:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448625.987252:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448625.987253:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448625.987255:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448625.987256:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448625.987258:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448625.987260:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448625.987263:0:14403:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1788448625.987266:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448625.987272:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448625.987274:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448625.987275:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448625.987277:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448625.987278:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448625.987279:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448625.987280:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448625.987281:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448625.987283:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788448625.987312:0:14403:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788448625.987331:0:14403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926964224:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448625.987417:0:14403:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448625.987458:0:14403:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250900 going to sleep for 11 seconds 00000100:00100000:0.0:1788448625.992402:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964224 00000100:00100000:0.0:1788448625.992418:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964224 00000100:00100000:0.0:1788448625.992683:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788448625.992695:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14403:x1875323926964224:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448625.992728:0:14415:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788448625.992742:0:14415:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788448626.093983:0:14415:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788448626.094007:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788448626.095803:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788448626.095813:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788448626.095843:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.095864:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.095872:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.095920:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.095937:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 12 pid: 14413 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448626.095953:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926964352:0@lo:104: 00000100:00100000:3.0:1788448626.096043:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448626.096176:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a806482c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448626.098512:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964352 00000100:00100000:0.0:1788448626.098535:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964352 00000100:00100000:0.0:1788448626.098646:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448626.098658:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926964352:12345-0@lo:104: 00010000:00010000:0.0:1788448626.098678:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448626.098773:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788448626.098780:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926964352:12345-0@lo:104: Request processed in 125us (2737us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448626.098788:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448626.099837:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926964352:0@lo:104: 00010000:00010000:3.0:1788448626.099880:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101132:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448626.101146:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101157:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448626.101161:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101172:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448626.101181:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448626.101359:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788448626.101409:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101416:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448626.101442:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101460:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf20 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf27 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.101479:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448626.101481:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448626.101483:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448626.101545:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5961e328-478c-41d0-979d-0dab1f06ac13:3312:1875323926964480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448626.101795:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448626.108297:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964480 00000100:00100000:1.0:1788448626.108313:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964480 00010000:00010000:1.0:1788448626.108354:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 13 pid: 14413 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448626.108396:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448626.108406:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961e328-478c-41d0-979d-0dab1f06ac13+13:3312:x1875323926964480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448626.108420:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448626.108426:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 13 pid: 14413 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108439:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 13 pid: 14413 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108457:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810758200/0xd0e9b344b90abf27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90abf20 expref: 13 pid: 14413 timeout: 586 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108475:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108482:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788448626.108510:0:14406:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012688060s 00010000:00010000:1.0:1788448626.108516:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108524:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108531:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108553:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108559:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448626.108563:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108571:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108592:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448626.108603:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448626.108752:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.108760:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.108766:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf58 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448626.108924:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961e328-478c-41d0-979d-0dab1f06ac13+12:3312:x1875323926964480:12345-0@lo:103:ldlm_bl.0 Request processed in 519us (7128us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448626.108933:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448626.109023:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5961e328-478c-41d0-979d-0dab1f06ac13:3312:1875323926964480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448626.110091:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+11:14403:x1875323926964224:12345-0@lo:253:mount.lustre.0 Request processed in 117386us (122662us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448626.110101:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788448626.110495:0:14403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:14403:1875323926964224:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448626.110574:0:14403:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788448626.110578:0:14403:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448626.110580:0:14403:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788448626.110581:0:14403:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448626.110582:0:14403:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448626.110584:0:14403:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448626.110585:0:14403:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448626.110586:0:14403:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788448626.110588:0:14403:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788448626.110590:0:14403:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448626.110591:0:14403:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788448626.110666:0:14403:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1788448626.120422:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.120603:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448626.125364:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.126517:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448626.127380:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.127689:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448626.128974:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.129360:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448626.130805:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.131442:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1788448626.132442:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1788448626.132768:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:0.0:1788448626.168351:0:14403:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788448626.168886:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:0.0:1788448626.169306:0:14460:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:0.0:1788448626.169375:0:14460:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448626.175260:0:14460:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788448626.175397:0:14460:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788448626.175402:0:14460:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:1.0:1788448626.176346:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1788448626.176471:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1788448626.176702:0:14459:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1788448626.176707:0:14459:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:1.0:1788448626.177707:0:14403:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788448626.177722:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1788448626.178456:0:14403:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448626.180365:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788448626.181418:0:14403:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788448626.181463:0:14403:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1788448626.186674:0:14403:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1788448626.202051:0:14403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1788448626.288252:0:14403:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1788448626.288473:0:14403:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbbcbc0d7f988 00100000:10000000:3.0:1788448626.288481:0:14403:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788448626.293414:0:14403:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788448626.293435:0:14403:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788448626.293447:0:14403:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1788448626.293525:0:14403:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1788448626.592479:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448626.979613:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788448626.979620:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a70705f000 from 6 10000000:01000000:2.0:1788448626.979624:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788448626.979730:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.979742:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448626.979755:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448626.979799:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926964608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448626.979872:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448626.979924:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8092a4a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448626.980739:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964608 00000100:00100000:3.0:1788448626.980751:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964608 00000100:00100000:3.0:1788448626.980805:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448626.980823:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14417:x1875323926964608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448626.980837:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448626.980851:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf5f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.980876:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.980886:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.980896:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39000, rc 0) 00000100:00100000:3.0:1788448626.980943:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926964608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (1071us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448626.980961:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788448626.981006:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926964608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448626.981022:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448626.981032:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448626.981108:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926964736:0@lo:256:ll_cfg_requeue.0 00000040:00080000:0.0:1788448626.981126:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788448626.981141:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448626.981170:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41300 going to sleep for 11 seconds 00000100:00100000:3.0:1788448626.981200:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964736 00000100:00100000:3.0:1788448626.981204:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964736 00000100:00100000:3.0:1788448626.981234:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788448626.981242:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926964736:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448626.981256:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448626.981271:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448626.981274:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1788448626.981363:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926964736:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 122us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448626.981370:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788448626.981526:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926964736:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788448626.981566:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788448626.981574:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448626.981583:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448627.616418:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448628.001099:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788448628.641499:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448629.664331:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448630.688387:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788448631.394621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448631.394628:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448631.394631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448631.394633:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448631.394636:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788448631.394639:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788448631.394642:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a80579d000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448631.394654:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff99a80579d000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448631.394780:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926964864:0@lo:400:kworker.0 00000100:00100000:3.0:1788448631.394859:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448631.394956:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964864 00000100:00100000:3.0:1788448631.394964:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964864 00000100:00100000:3.0:1788448631.395125:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448631.395136:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:3309:x1875323926964864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448631.395211:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:3309:x1875323926964864:12345-0@lo:400:kworker.0 Request processed in 77us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448631.395219:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788448631.395281:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926964864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448631.395519:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83d2e4380 x1875323926964992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788448631.395749:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926964992:0@lo:38:kworker.0 00000100:00100000:1.0:1788448631.395788:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448631.395944:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926964992 00000100:00100000:2.0:1788448631.395951:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926964992 00000100:00100000:2.0:1788448631.398365:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448631.398391:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3308:x1875323926964992:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788448631.398421:0:14422:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 492 last 0 00000020:00000080:2.0:1788448631.398471:0:14422:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xd0e9b344b90abf6d 00000004:00100000:2.0:1788448631.398491:0:14422:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788448631.398751:0:14422:0:(import.c:65:import_set_state_nolock()) ffff99a80bad9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448631.398851:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1875323926964992:12345-0@lo:38:kworker.0 Request processed in 465us (3060us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448631.398870:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788448631.399307:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a83d2e4380 x1875323926964992/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448641 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448631.399337:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788448631.399346:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788448631.399352:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788448631.399354:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a80579d000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788448631.399360:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3308:1875323926964992:0@lo:38:kworker.0 00010000:00010000:1.0:1788448631.712688:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448631.941540:0:14703:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1788448632.736530:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448633.760659:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448634.786359:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448635.489500:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448625/real 1788448625] req@ffff99a83d2e7b80 x1875323926962304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448635.489532:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a83d2e7b80 x1875323926962304/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448635.489542:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448625/real 1788448625] req@ffff99a835638380 x1875323926962176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448635 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448635.489554:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a835638380 x1875323926962176/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448635 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788448635.489593:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448635.489616:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448635.489622:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926962304:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788448635.489629:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83fc68000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788448635.489635:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788448635.489639:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926962176:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788448635.489758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448635.489762:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788448635.489765:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a83fc68000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448635.489771:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788448635.489776:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448635.489793:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a83fc68000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448635.489816:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83563bb80 x1875323926965248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448635.489830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448635.489833:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788448635.489835:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788448635.489838:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 486 00000100:00080000:3.0:1788448635.489840:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788448635.489844:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448635.489855:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a835639f80 x1875323926965376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448635.489904:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926965120:0@lo:400:kworker.0 00000100:00100000:3.0:1788448635.489969:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448635.494682:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926965504:0@lo:400:kworker.0 00000100:00100000:3.0:1788448635.494759:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448635.494827:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926965120 00000100:00100000:3.0:1788448635.494836:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926965120 00000100:00100000:3.0:1788448635.494888:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448635.495131:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:3310:x1875323926965120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448635.495210:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:3310:x1875323926965120:12345-0@lo:400:kworker.0 Request processed in 313us (5241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448635.495219:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788448635.495263:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926965248:0@lo:8:kworker.0 00000400:00000100:3.0:1788448635.495293:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323926965248 offset 0 length 520: 4 00000100:00100000:3.0:1788448635.495318:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926965376:0@lo:8:kworker.0 00000400:00000100:3.0:1788448635.495343:0:3308:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875323926965376 offset 0 length 520: 4 00000100:00100000:3.0:1788448635.495551:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926965120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448635.496012:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926965504 00000100:00100000:1.0:1788448635.496018:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926965504 00000100:00100000:1.0:1788448635.496056:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448635.496065:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926965504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448635.496117:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926965504:12345-0@lo:400:kworker.0 Request processed in 53us (1360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448635.496124:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788448635.496161:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a83563b480 x1875323926965504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448635.496174:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926965504:0@lo:400:kworker.0 00000020:00000080:3.0:1788448635.703961:0:14854:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe543b7790 20000000:00000080:3.0:1788448635.703978:0:14854:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a802cc9000 uarg=0000000000000000 20000000:01000000:3.0:1788448635.704010:0:14854:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788448635.704018:0:14854:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788448635.704023:0:14854:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1788448635.704953:0:14855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1788448635.705119:0:14854:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788448635.717515:0:14854:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788448635.717546:0:14854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.717564:0:14854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.717590:0:14854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.717629:0:14854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 11 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.717643:0:14854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 11 pid: 14415 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448635.717658:0:14854:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14854:1875323926965632:0@lo:104: 00000100:00100000:3.0:1788448635.717729:0:14854:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448635.717802:0:14854:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41180 going to sleep for 11 seconds 00000100:00100000:1.0:1788448635.718887:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926965632 00000100:00100000:1.0:1788448635.718899:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926965632 00000100:00100000:1.0:1788448635.718957:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448635.718967:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14854:x1875323926965632:12345-0@lo:104: 00010000:00010000:1.0:1788448635.718983:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448635.719075:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448635.719082:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14854:x1875323926965632:12345-0@lo:104: Request processed in 116us (1353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448635.719089:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1788448635.719128:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448635.719146:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719156:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629a00 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:2.0:1788448635.719161:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719170:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788448635.719178:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448635.719216:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:3.0:1788448635.719222:0:14854:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14854:1875323926965632:0@lo:104: 00010000:00010000:3.0:1788448635.719244:0:14854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719257:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719265:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788448635.719296:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719303:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629a00/0xd0e9b344b90abf2e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf35 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719322:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448635.719324:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448635.719325:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448635.719342:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788448635.719355:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926965760:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448635.719403:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448635.719444:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926965760 00000100:00100000:2.0:1788448635.719449:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926965760 00010000:00010000:2.0:1788448635.719469:0:14406:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 12 pid: 14415 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.719493:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448635.719500:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961e328-478c-41d0-979d-0dab1f06ac13+12:3311:x1875323926965760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448635.719511:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448635.719527:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 12 pid: 14415 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719541:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 12 pid: 14415 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719568:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83cc9c600/0xd0e9b344b90abf35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90abf2e expref: 12 pid: 14415 timeout: 596 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719581:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719588:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719601:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719608:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719614:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719619:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719625:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448635.719628:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719634:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719654:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448635.719674:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448635.719686:0:14854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.719696:0:14854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448635.719703:0:14854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abf74 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448635.719714:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5961e328-478c-41d0-979d-0dab1f06ac13+11:3311:x1875323926965760:12345-0@lo:103:ldlm_bl.0 Request processed in 214us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448635.719724:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448635.720943:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926965760:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448635.810964:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448636.833330:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788448637.408383:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448637.408391:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a70705f000 from 10 10000000:01000000:2.0:1788448637.408396:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448637.408448:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.408459:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.408470:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448637.408498:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926965888:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448637.408851:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448637.408969:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448637.409599:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926965888 00000100:00100000:3.0:1788448637.409610:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926965888 00000100:00100000:3.0:1788448637.409664:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788448637.409674:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+11:14417:x1875323926965888:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448637.409702:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448637.409718:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf7b expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448637.409754:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448637.409766:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448637.409775:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38000, rc 0) 00000100:00100000:3.0:1788448637.409833:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926965888:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 161us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448637.409840:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788448637.411492:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926965888:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448637.411522:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448637.411535:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448637.411638:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926966016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448637.411699:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448637.411800:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966016 00000100:00100000:3.0:1788448637.411807:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966016 00000100:00100000:3.0:1788448637.411860:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448637.411870:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926966016:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448637.412162:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926966016:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 292us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448637.412170:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788448637.415363:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448637.415416:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926966016:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448637.415480:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926966144:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448637.415772:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448637.415811:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a707250240 going to sleep for 11 seconds 00000100:00100000:3.0:1788448637.416115:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966144 00000100:00100000:3.0:1788448637.416304:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966144 00000100:00100000:3.0:1788448637.416403:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788448637.416413:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926966144:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448637.416650:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:14417:x1875323926966144:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 237us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448637.416668:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448637.416766:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926966144:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788448637.418958:0:14916:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1788448637.420143:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1788448637.420171:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448637.420202:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448637.420216:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448637.856343:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448638.246834:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448638.883495:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448639.905122:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788448640.614067:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448640.614082:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788448640.614086:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448640.614090:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448640.614217:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926966272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448640.615442:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448640.615548:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788448640.615561:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926966400:0@lo:400:kworker.0 00000100:00100000:3.0:1788448640.615608:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448640.615664:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966272 00000100:00100000:3.0:1788448640.615673:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966272 00000100:00100000:3.0:1788448640.615747:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448640.615759:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:3309:x1875323926966272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448640.615838:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+12:3309:x1875323926966272:12345-0@lo:400:kworker.0 Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.615849:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788448640.615901:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966400 00000100:00100000:3.0:1788448640.615906:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966400 00000100:00100000:1.0:1788448640.616668:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926966272:0@lo:400:kworker.0 00000100:00100000:3.0:1788448640.617533:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788448640.617556:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926966400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448640.617669:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926966400:12345-0@lo:400:kworker.0 Request processed in 123us (2059us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448640.617678:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788448640.617739:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a704685c00 x1875323926966400/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448656 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448640.617757:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926966400:0@lo:400:kworker.0 00010000:00010000:3.0:1788448640.929358:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448641.616930:0:15104:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448641.616935:0:15104:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1788448641.617088:0:15104:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a834854800 00000020:01000004:3.0:1788448641.617104:0:15104:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788448641.617117:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1788448641.617144:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff99a802d80000) 00000020:00000080:3.0:1788448641.617161:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1788448641.670364:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1788448641.670658:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1788448641.671415:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1788448641.671881:0:15104:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1788448641.672081:0:15104:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1788448641.672529:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 451: rc = 0 00100000:10000000:0.0:1788448641.672620:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 451: rc = 0 00100000:10000000:0.0:1788448641.672775:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 451: rc = 0 00100000:10000000:0.0:1788448641.673375:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 588: rc = 0 00100000:10000000:0.0:1788448641.673704:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 588: rc = 0 00100000:10000000:0.0:1788448641.673952:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 588: rc = 0 00100000:10000000:0.0:1788448641.674376:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 588: rc = 0 00100000:10000000:0.0:1788448641.674639:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 588: rc = 0 00100000:10000000:0.0:1788448641.674933:0:15104:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 588: rc = 0 00000020:00000080:0.0:1788448641.675633:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788448641.675645:0:15104:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788448641.675657:0:15104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd0e9b344b90abf90 00000020:01000004:0.0:1788448641.675677:0:15104:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1788448641.675698:0:15104:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788448641.675702:0:15104:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788448641.675708:0:15104:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788448641.675712:0:15104:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788448641.675724:0:15104:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff99a8075e8000) 00000020:00000080:0.0:1788448641.675734:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1788448641.677994:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448641.678653:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788448641.678660:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1788448641.685612:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448641.685624:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1788448641.685924:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448641.685930:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788448641.687438:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448641.687642:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788448641.687646:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788448641.688465:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788448641.688473:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1788448641.711505:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448641.711763:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788448641.711770:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1788448641.713105:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788448641.713117:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788448641.719220:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788448641.719238:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1788448641.722113:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788448641.722335:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1788448641.722342:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1788448641.723706:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1788448641.723716:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788448641.762865:0:15104:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788448641.763064:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788448641.763071:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788448641.766363:0:15104:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788448641.766376:0:15104:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788448641.766833:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788448641.766861:0:15104:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1788448641.766867:0:15104:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788448641.780091:0:15104:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788448641.780272:0:15104:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.137@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788448641.780277:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788448641.780279:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448641.780280:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448641.780281:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448641.780283:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448641.780284:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448641.780285:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448641.780292:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448641.780294:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448641.780297:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788448641.780299:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788448641.780300:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448641.780301:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448641.780302:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448641.780303:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448641.780304:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448641.780305:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448641.780306:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448641.780306:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788448641.780332:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788448641.780354:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966528:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788448641.780437:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.780549:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.781032:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966528 00000100:00100000:3.0:1788448641.781039:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966528 00000100:00100000:3.0:1788448641.781153:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788448641.781164:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:15104:x1875323926966528:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788448641.781279:0:14415:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788448641.781283:0:14415:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1788448641.781287:0:14415:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:3.0:1788448641.786678:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:15104:x1875323926966528:12345-0@lo:253:mount.lustre.0 Request processed in 5496us (6221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.786692:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788448641.786807:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966528:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788448641.786825:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788448641.786828:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788448641.786829:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788448641.786830:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788448641.786832:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788448641.786833:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788448641.786834:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788448641.786835:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788448641.786836:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788448641.786837:0:15104:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788448641.786858:0:15104:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a834854800 from lustre-OST0000 10000000:01000000:2.0:1788448641.786885:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788448641.786888:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788448641.786894:0:15104:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a83e70cd28 local copy 00010000:00010000:2.0:1788448641.786903:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448641.787142:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966656:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448641.787233:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.787265:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeab40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448641.787375:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966656 00000100:00100000:0.0:1788448641.787383:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966656 00000100:00100000:0.0:1788448641.787418:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788448641.787428:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:15104:x1875323926966656:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.787602:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+12:15104:x1875323926966656:12345-0@lo:501:mount.lustre.0 Request processed in 174us (369us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448641.787610:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788448641.787731:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966656:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448641.787744:0:15104:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448641.787901:0:15104:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448641.787908:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.787916:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448641.787938:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a834854800 10000000:01000000:2.0:1788448641.787943:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448641.787947:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff99a83e70cd28 10000000:01000000:2.0:1788448641.787949:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788448641.787952:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff99a83e70cd28 from 1 10000000:01000000:2.0:1788448641.787955:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788448641.787978:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.787985:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.787993:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448641.788008:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966784:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448641.788034:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.788066:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.788168:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966784 00000100:00100000:3.0:1788448641.788173:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966784 00000100:00100000:3.0:1788448641.788231:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788448641.788240:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+12:15104:x1875323926966784:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448641.788250:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448641.788262:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abfa5 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abf9e expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.788282:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abfa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abf9e expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.788293:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc38600/0xd0e9b344b90abfa5 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf9e expref: 13 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.788301:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38600, rc 0) 00000100:00100000:3.0:1788448641.788335:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+13:15104:x1875323926966784:12345-0@lo:101:mount.lustre.0 Request processed in 97us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.788351:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788448641.788596:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966784:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448641.788610:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfa5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.788619:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abfa5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448641.788636:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1788448641.788698:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfa5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.788706:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629800/0xd0e9b344b90abf9e lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfa5 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448641.788712:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788448641.788716:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448641.788720:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788448641.788722:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788448641.788737:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.788743:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.788750:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448641.788761:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966912:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448641.788800:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.788835:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eeab40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.788930:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926966912 00000100:00100000:3.0:1788448641.788935:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926966912 00000100:00100000:3.0:1788448641.788970:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788448641.788978:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+13:15104:x1875323926966912:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448641.788986:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448641.788995:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc39200/0xd0e9b344b90abfb3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abfac expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.789009:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc39200/0xd0e9b344b90abfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abfac expref: 14 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.789017:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc39200/0xd0e9b344b90abfb3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abfac expref: 14 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.789023:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39200, rc 0) 00000100:00100000:3.0:1788448641.789061:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926966912:12345-0@lo:101:mount.lustre.0 Request processed in 83us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.789066:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788448641.789137:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926966912:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448641.789148:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfb3 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.789156:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abfb3 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448641.789862:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788448641.790711:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448641.790976:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788448641.791020:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788448641.791054:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788448641.791096:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788448641.791126:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788448641.791159:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788448641.791296:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788448641.791305:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788448641.791389:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448641.791445:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.791476:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448641.792016:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967040 00000100:00100000:0.0:1788448641.792025:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967040 00000100:00100000:0.0:1788448641.792075:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788448641.792084:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967040:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.792467:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967040:12345-0@lo:501:mount.lustre.0 Request processed in 383us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448641.792476:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788448641.795617:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967040:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448641.795696:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967168:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448641.795780:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.795818:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea780 going to sleep for 11 seconds 00000100:00100000:0.0:1788448641.796063:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967168 00000100:00100000:0.0:1788448641.796071:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967168 00000100:00100000:0.0:1788448641.796130:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788448641.796139:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448641.796555:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967168:12345-0@lo:503:mount.lustre.0 Request processed in 415us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448641.796564:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788448641.796831:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967168:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788448641.797411:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788448641.797483:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967296:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448641.797537:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.797578:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.797721:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967296 00000100:00100000:1.0:1788448641.797728:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967296 00000100:00100000:1.0:1788448641.797760:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788448641.797780:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967296:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448641.797982:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967296:12345-0@lo:502:mount.lustre.0 Request processed in 213us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.797990:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788448641.798169:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967296:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448641.798485:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788448641.798537:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788448641.798575:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788448641.798649:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788448641.798703:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788448641.798737:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788448641.798929:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788448641.798971:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788448641.799002:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1788448641.799050:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1788448641.799084:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1788448641.799132:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1788448641.799169:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967424:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448641.799241:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448641.799329:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704eea780 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.799364:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967424 00000100:00100000:1.0:1788448641.799371:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967424 00000100:00100000:1.0:1788448641.799534:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788448641.799545:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967424:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448641.799742:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967424:12345-0@lo:502:mount.lustre.0 Request processed in 198us (500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.799751:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788448641.799833:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448641.799903:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1788448641.799912:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1788448641.800821:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788448641.800830:0:15118:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1788448641.800837:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.800839:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1788448641.800844:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788448641.800859:0:15118:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff99a80649b370) 00000020:00000080:2.0:1788448641.800891:0:15118:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788448641.800897:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788448641.800982:0:15118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a834854800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1788448641.800989:0:15118:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788448641.800996:0:15118:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xd0e9b344b90abfc1 00010000:00010000:2.0:1788448641.804935:0:15118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1788448641.806365:0:15118:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1788448641.808529:0:15118:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1788448641.813457:0:15118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1788448641.813469:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448641.813476:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813478:0:15118:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1788448641.813481:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788448641.813484:0:15118:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788448641.813486:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448641.813487:0:15118:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788448641.813489:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788448641.813492:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813493:0:15118:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788448641.813496:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448641.813499:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813500:0:15118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788448641.813503:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788448641.813505:0:15118:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788448641.813508:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448641.813510:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813511:0:15118:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788448641.813514:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788448641.813515:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813516:0:15118:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788448641.813519:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788448641.813579:0:15118:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788448641.813583:0:15118:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788448641.813584:0:15118:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788448641.813587:0:15118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1788448641.816180:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1788448641.816251:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788448641.816278:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfb3 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448641.816291:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628200/0xd0e9b344b90abfac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfb3 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448641.816299:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a834854800 from 1 10000000:01000000:0.0:1788448641.816302:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448641.816345:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448641.816353:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448641.816373:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448641.816399:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788448641.816468:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.816513:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.816844:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967552 00000100:00100000:3.0:1788448641.816852:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967552 00000100:00100000:3.0:1788448641.816901:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788448641.816909:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+14:15104:x1875323926967552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448641.816922:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448641.816935:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abfc8 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.816960:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.816981:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 15 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.816991:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc39600, rc 0) 00000100:00100000:3.0:1788448641.817031:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967552:12345-0@lo:101:mount.lustre.0 Request processed in 122us (562us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.817037:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788448641.817179:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788448641.817221:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448641.817231:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448641.817863:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1788448641.820422:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788448641.821017:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1788448641.821071:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1788448641.821138:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1788448641.821147:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1788448641.821927:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.821993:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.822086:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.823972:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967680 00000100:00100000:1.0:1788448641.823990:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967680 00000100:00100000:1.0:1788448641.824087:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788448641.824098:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967680:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448641.824431:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967680:12345-0@lo:501:mount.lustre.0 Request processed in 333us (2436us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.824439:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788448641.825720:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967680:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.825790:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967808:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448641.825859:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.829413:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.829509:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967808 00000100:00100000:3.0:1788448641.829519:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967808 00000100:00100000:3.0:1788448641.829565:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788448641.829576:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967808:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448641.829877:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967808:12345-0@lo:503:mount.lustre.0 Request processed in 302us (4016us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.829889:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788448641.830006:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788448641.830541:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448641.830612:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448641.830672:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.830691:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.830911:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926967936 00000100:00100000:3.0:1788448641.830917:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926967936 00000100:00100000:3.0:1788448641.830944:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788448641.830952:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967936:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448641.831126:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926967936:12345-0@lo:502:mount.lustre.0 Request processed in 173us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.831134:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788448641.831231:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926967936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448641.831491:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788448641.831538:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788448641.831615:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788448641.831655:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788448641.831700:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788448641.831747:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788448641.831904:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788448641.831942:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1788448641.831975:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448641.832018:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.832055:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80863bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.832130:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968064 00000100:00100000:1.0:1788448641.832136:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968064 00000100:00100000:1.0:1788448641.832170:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788448641.832178:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926968064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448641.832353:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926968064:12345-0@lo:502:mount.lustre.0 Request processed in 175us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.832361:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788448641.833302:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448641.833455:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788448641.833469:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1788448641.835619:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448641.835632:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835634:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788448641.835641:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a834854800 00000020:00000080:0.0:1788448641.835643:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448641.835650:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448641.835652:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835654:0:15122:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788448641.835680:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448641.835684:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835685:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788448641.835689:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a834854800 00000020:00000080:0.0:1788448641.835691:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448641.835745:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448641.835749:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835750:0:15122:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788448641.835753:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788448641.835755:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835757:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788448641.835760:0:15122:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a834854800 00000020:00000080:0.0:1788448641.835763:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788448641.835813:0:15122:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788448641.835816:0:15122:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788448641.835818:0:15122:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1788448641.835821:0:15122:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788448641.836071:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788448641.836092:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448641.836115:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836127:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448641.836174:0:15104:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788448641.836177:0:15104:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a834854800 10000000:01000000:1.0:1788448641.836181:0:15104:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a834854800 10000000:01000000:1.0:1788448641.836216:0:15104:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448641.836223:0:15104:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a834854800 from 1 10000000:01000000:1.0:1788448641.836226:0:15104:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788448641.836263:0:15104:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836272:0:15104:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836288:0:15104:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448641.836310:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968192:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448641.836372:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448641.836410:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968192 00000100:00100000:1.0:1788448641.836416:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968192 00000100:00100000:1.0:1788448641.836462:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448641.836471:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926968192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448641.836485:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448641.836500:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90abfdd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90abfd6 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836523:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90abfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90abfd6 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836533:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83cc9d600/0xd0e9b344b90abfdd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abfd6 expref: 16 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.836542:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83cc9d600, rc 0) 00000100:00100000:1.0:1788448641.836577:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968192:12345-0@lo:101:mount.lustre.0 Request processed in 107us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.836583:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788448641.844877:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923cf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.844924:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968192:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448641.844950:0:15104:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfdd expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.844971:0:15104:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90abfdd expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448641.845595:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1788448641.849416:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448641.849750:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788448641.851497:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788448641.851556:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788448641.851630:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788448641.851701:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788448641.851751:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788448641.852911:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788448641.852968:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788448641.853031:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788448641.853069:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788448641.853105:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788448641.853154:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788448641.854322:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788448641.854390:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788448641.854456:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788448641.856988:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788448641.857029:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788448641.857100:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788448641.857137:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788448641.857170:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788448641.857257:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788448641.857294:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788448641.857324:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788448641.857372:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788448641.857408:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788448641.857443:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788448641.857506:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788448641.857543:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788448641.857631:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788448641.857640:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1788448641.857758:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448641.859322:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448641.861493:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923cf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788448641.866074:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968320 00000100:00100000:0.0:1788448641.866093:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968320 00000100:00100000:0.0:1788448641.866150:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448641.866162:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968320:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.866494:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968320:12345-0@lo:501:mount.lustre.0 Request processed in 333us (7175us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448641.866502:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788448641.867271:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788448641.867325:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448641.867375:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.867413:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a6710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.868896:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968448 00000100:00100000:3.0:1788448641.868906:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968448 00000100:00100000:3.0:1788448641.868990:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788448641.869000:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448641.869229:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968448:12345-0@lo:503:mount.lustre.0 Request processed in 230us (1853us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.869243:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788448641.876075:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788448641.876994:0:15104:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788448641.877080:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448641.877160:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.877219:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a6710c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448641.878008:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968576 00000100:00100000:3.0:1788448641.878017:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968576 00000100:00100000:3.0:1788448641.878073:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788448641.878082:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968576:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448641.878463:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968576:12345-0@lo:502:mount.lustre.0 Request processed in 380us (1302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.878471:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788448641.878673:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788448641.880360:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788448641.880443:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1788448641.880480:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1788448641.880528:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788448641.886159:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788448641.886303:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788448641.886346:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788448641.886384:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788448641.886431:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788448641.886468:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788448641.886504:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788448641.886552:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788448641.887039:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788448641.887077:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788448641.887148:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788448641.887206:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788448641.887247:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788448641.887295:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788448641.887331:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788448641.887361:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788448641.887411:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788448641.887449:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788448641.887480:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788448641.887544:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788448641.888453:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788448641.888501:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788448641.888562:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788448641.888693:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788448641.888729:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788448641.892142:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788448641.892276:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788448641.892313:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788448641.892347:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788448641.892396:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788448641.892434:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788448641.892487:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788448641.892525:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788448641.892558:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1788448641.895579:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1788448641.895630:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1788448641.895845:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448641.895940:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448641.895990:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80a671000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.897267:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968704 00000100:00100000:1.0:1788448641.897279:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968704 00000100:00100000:1.0:1788448641.897344:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788448641.897354:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448641.897633:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926968704:12345-0@lo:502:mount.lustre.0 Request processed in 280us (1692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.897640:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788448641.897842:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdffb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926968704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788448641.897957:0:15104:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1788448641.897972:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1788448641.901761:0:15127:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788448641.901780:0:15127:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff99a8075eb370) 00000020:00000080:0.0:1788448641.901803:0:15127:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1788448641.901889:0:15127:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a834854800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788448641.901893:0:15127:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a834854800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1788448641.901895:0:15127:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a834854800 3 00010000:00080000:0.0:1788448641.901924:0:15127:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a7054a3800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.137@tcp at head 00010000:00010000:0.0:1788448641.906626:0:15127:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1788448641.906876:0:15127:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1788448641.906917:0:15127:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788448641.906935:0:15127:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xd0e9b344b90abfeb 00000100:00080000:0.0:1788448641.906945:0:15127:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788448641.906951:0:15127:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff99a7054a3800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1788448641.906987:0:15127:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83cdfe300 x1875323926968832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448641.907012:0:15127:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788448641.907684:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448641.907691:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788448641.907694:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448641.907697:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448641.909041:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926968832:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788448641.909119:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.909213:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448641.909222:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926968960:0@lo:400:kworker.0 00000100:00100000:3.0:1788448641.909249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.909284:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968832 00000100:00100000:3.0:1788448641.909292:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968832 00000100:00100000:3.0:1788448641.909336:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926968960 00000100:00100000:3.0:1788448641.909340:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926968960 00000100:00100000:3.0:1788448641.909369:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448641.909391:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926968960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448641.909448:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1875323926968960:12345-0@lo:400:kworker.0 Request processed in 60us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.909455:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448641.909475:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448641.909481:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3308:x1875323926968832:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788448641.909505:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 502 last 0 00000020:00000080:3.0:1788448641.909548:0:14420:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xd0e9b344b90abff2 00000004:00100000:3.0:1788448641.909571:0:14420:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788448641.909604:0:14420:0:(import.c:65:import_set_state_nolock()) ffff99a83e703000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448641.909651:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1875323926968832:12345-0@lo:38:llog_process_th.0 Request processed in 169us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448641.909669:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788448641.909719:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a83d2e6d80 x1875323926968960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448657 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448641.909733:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3312:1875323926968960:0@lo:400:kworker.0 00010000:00080000:2.0:1788448641.912543:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff99a83cdfe300 x1875323926968832/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448651 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448641.912732:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448641.912745:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:2.0:1788448641.912755:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448641.912761:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448641.912765:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a7054a3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448641.912783:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3308:1875323926968832:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1788448641.913422:0:15127:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:1.0:1788448641.913499:0:15104:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1788448641.913537:0:15104:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788448641.913570:0:15104:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfdd expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.913583:0:15104:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a83cc9da00/0xd0e9b344b90abfd6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abfdd expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788448641.913647:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788448641.913649:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448641.913650:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448641.913651:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448641.913653:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448641.913654:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448641.913665:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448641.913668:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448641.913669:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448641.913673:0:15104:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1788448641.913675:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788448641.913677:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788448641.913678:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788448641.913679:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788448641.913681:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788448641.913682:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788448641.913683:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788448641.913684:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788448641.913685:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788448641.913711:0:15104:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788448641.913731:0:15104:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926969088:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788448641.913815:0:15104:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448641.913856:0:15104:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788448641.914012:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969088 00000100:00100000:2.0:1788448641.914020:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969088 00000100:00100000:2.0:1788448641.914068:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788448641.914078:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:15104:x1875323926969088:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1788448641.914105:0:14414:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1788448641.914132:0:14414:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:0.0:1788448641.953062:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:1.0:1788448641.978099:0:14414:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788448641.978123:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788448641.978167:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788448641.978174:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788448641.978241:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.978261:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.978269:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.978320:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.978337:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 16 pid: 14413 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448641.978352:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926969216:0@lo:104: 00000100:00100000:3.0:1788448641.978418:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.978469:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8064823c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448641.978546:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969216 00000100:00100000:1.0:1788448641.978555:0:14405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969216 00000100:00100000:1.0:1788448641.978613:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448641.978623:0:14405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926969216:12345-0@lo:104: 00010000:00010000:1.0:1788448641.978635:0:14405:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448641.978697:0:14405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448641.978716:0:14405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926969216:12345-0@lo:104: Request processed in 95us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.978723:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788448641.979766:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448641.979792:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.979801:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448641.979805:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.979813:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448641.979819:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448641.979824:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788448641.979866:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.979872:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448641.979898:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.979904:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629200/0xd0e9b344b90abf5f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf66 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448641.979919:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448641.979921:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448641.979922:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448641.979929:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448641.979941:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926969344:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448641.979980:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448641.980032:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926969216:0@lo:104: 00010000:00010000:3.0:1788448641.980058:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448641.980121:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969344 00000100:00100000:2.0:1788448641.980126:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969344 00010000:00010000:2.0:1788448641.980151:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 17 pid: 14413 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448641.980211:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448641.980221:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961e328-478c-41d0-979d-0dab1f06ac13+17:3311:x1875323926969344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448641.980242:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448641.980247:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 17 pid: 14413 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980268:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 17 pid: 14413 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980281:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc39000/0xd0e9b344b90abf66 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90abf5f expref: 17 pid: 14413 timeout: 602 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980295:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980302:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788448641.980325:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012688060s 00010000:00010000:2.0:1788448641.980329:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980335:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980342:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980348:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980353:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448641.980357:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980365:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980386:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980395:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448641.980429:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961e328-478c-41d0-979d-0dab1f06ac13+16:3311:x1875323926969344:12345-0@lo:103:ldlm_bl.0 Request processed in 210us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448641.980436:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788448641.980465:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926969344:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448641.980482:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980488:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448641.980494:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc38200/0xd0e9b344b90abff9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448641.989276:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+15:15104:x1875323926969088:12345-0@lo:253:mount.lustre.0 Request processed in 75189us (75451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448641.989291:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788448641.989463:0:15104:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15104:1875323926969088:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448641.989480:0:15104:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1788448641.989484:0:15104:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448641.989485:0:15104:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788448641.989487:0:15104:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448641.989488:0:15104:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448641.989489:0:15104:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448641.989490:0:15104:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448641.989492:0:15104:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448641.989494:0:15104:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448641.989495:0:15104:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448641.989508:0:15104:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788448641.997572:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448641.998541:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448641.998752:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448641.999442:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448641.999724:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448642.000594:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1788448642.003741:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788448642.138145:0:15104:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788448642.138155:0:15104:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788448642.138207:0:15104:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788448642.138275:0:15104:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788448642.138288:0:15104:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1788448642.138315:0:15104:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1788448642.978274:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788448643.425239:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788448643.425247:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a70705f000 from 7 10000000:01000000:0.0:1788448643.425252:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788448643.425304:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448643.425326:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448643.425339:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448643.425365:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926969472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448643.425435:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448643.425499:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a801254180 going to sleep for 11 seconds 00000100:00100000:3.0:1788448643.425873:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969472 00000100:00100000:3.0:1788448643.425882:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969472 00000100:00100000:3.0:1788448643.425978:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788448643.425989:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+15:14417:x1875323926969472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448643.426003:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448643.426016:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac000 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448643.426039:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448643.426050:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 16 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448643.426060:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38800, rc 0) 00000100:00100000:3.0:1788448643.426122:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:14417:x1875323926969472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448643.426244:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926969472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788448643.426259:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448643.426269:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448643.426329:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926969600:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788448643.426367:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448643.426410:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788448643.428051:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8064823c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448643.428569:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969600 00000100:00100000:3.0:1788448643.428578:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969600 00000100:00100000:3.0:1788448643.428618:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448643.428637:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:14417:x1875323926969600:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788448643.428669:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788448643.428685:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788448643.428688:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1788448643.428985:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:14417:x1875323926969600:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 357us (2616us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448643.428994:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1788448643.429056:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926969600:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788448643.429220:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448643.429230:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448643.429241:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448644.002238:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448645.026297:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448646.049542:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448647.072699:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788448647.264344:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448647.264352:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788448647.264355:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788448647.264358:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788448647.264414:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926969856:0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448647.264551:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788448647.264568:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926969728:0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264597:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448647.264639:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926969984:0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264663:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448647.264696:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969856 00000100:00100000:3.0:1788448647.264704:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969856 00000100:00100000:3.0:1788448647.264740:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969984 00000100:00100000:3.0:1788448647.264744:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969984 00000100:00100000:3.0:1788448647.264781:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448647.264790:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926969856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264840:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926969856:12345-0@lo:400:kworker.0 Request processed in 50us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448647.264847:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448647.264864:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448647.264870:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926969984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264899:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926969984:12345-0@lo:400:kworker.0 Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448647.264905:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448647.264923:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926969728 00000100:00100000:3.0:1788448647.264926:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926969728 00000100:00100000:3.0:1788448647.264950:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788448647.264957:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:3310:x1875323926969728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448647.264985:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:3310:x1875323926969728:12345-0@lo:400:kworker.0 Request processed in 29us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448647.264991:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:3.0:1788448647.265046:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83563aa00 x1875323926969984/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448647.265060:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926969984:0@lo:400:kworker.0 00000100:00080000:1.0:1788448647.265237:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448647.265435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926969728:0@lo:400:kworker.0 00010000:00080000:3.0:1788448647.265447:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a835639c00 x1875323926969856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448663 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448647.265456:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926969856:0@lo:400:kworker.0 00010000:00010000:3.0:1788448648.096381:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788448648.481356:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788448648.916318:0:15472:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788448649.130642:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448650.081578:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448635/real 1788448635] req@ffff99a83563bb80 x1875323926965248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448650.081626:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a83563bb80 x1875323926965248/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448650.081637:0:3308:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788448635/real 1788448635] req@ffff99a835639f80 x1875323926965376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448650 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448650.081649:0:3308:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff99a835639f80 x1875323926965376/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788448650 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788448650.081668:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83fc68000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448650.081713:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788448650.081718:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926965248:0@lo:8:kworker.0 00000100:00080000:2.0:1788448650.081724:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448650.081730:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788448650.081733:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926965376:0@lo:8:kworker.0 00000100:00080000:0.0:1788448650.081916:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448650.081921:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788448650.081923:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a83fc68000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448650.081929:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1788448650.081934:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448650.081941:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff99a83fc68000 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1788448650.081961:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83cdfd180 x1875323926970240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788448650.081976:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448650.081979:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448650.081980:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448650.081983:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 496 00000100:00080000:0.0:1788448650.081986:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788448650.081989:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1788448650.081999:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83cdff480 x1875323926970368/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448650.082041:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448650.082054:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926970112:0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082114:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448650.082163:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926970496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082217:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448650.082238:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448650.082243:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926970624:0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082276:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448650.082312:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970112 00000100:00100000:0.0:1788448650.082320:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970112 00000100:00100000:0.0:1788448650.082376:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448650.082385:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:3311:x1875323926970112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082429:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:3311:x1875323926970112:12345-0@lo:400:kworker.0 Request processed in 45us (314us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448650.082436:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788448650.082469:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970496 00000100:00100000:0.0:1788448650.082473:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970496 00000100:00100000:0.0:1788448650.082497:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970624 00000100:00100000:0.0:1788448650.082512:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970624 00000100:00100000:0.0:1788448650.082540:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448650.082547:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926970496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082585:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926970496:12345-0@lo:400:kworker.0 Request processed in 39us (368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448650.082592:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448650.082604:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788448650.082625:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926970624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082655:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926970624:12345-0@lo:400:kworker.0 Request processed in 46us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448650.082661:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788448650.082684:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448650.082707:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926970112:0@lo:400:kworker.0 00010000:00080000:0.0:1788448650.082731:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83cdfe680 x1875323926970624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448650.082755:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfe680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926970624:0@lo:400:kworker.0 00010000:00080000:0.0:1788448650.082767:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83cdff800 x1875323926970496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448650.082774:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926970496:0@lo:400:kworker.0 00000100:00100000:0.0:1788448650.082793:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926970240:0@lo:8:kworker.0 00000100:00100000:0.0:1788448650.082820:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448650.082844:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926970368:0@lo:8:kworker.0 00000100:00100000:0.0:1788448650.082861:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448650.083170:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970240 00000100:00100000:3.0:1788448650.083176:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970240 00000100:00100000:3.0:1788448650.083856:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970368 00000100:00100000:3.0:1788448650.083862:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970368 00000100:00100000:2.0:1788448650.087660:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448650.087676:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875323926970240:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788448650.087711:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 510 last 0 00000020:00000080:2.0:1788448650.087743:0:15108:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90ac00e 00002000:00100000:2.0:1788448650.087759:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff99a706c72800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788448650.087764:0:15108:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788448650.087767:0:15108:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788448650.088087:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448650.088114:0:15108:0:(import.c:65:import_set_state_nolock()) ffff99a706c76800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448650.088249:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3308:x1875323926970240:12345-0@lo:8:kworker.0 Request processed in 574us (5426us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448650.088258:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788448650.088283:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448650.088289:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875323926970368:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788448650.088300:0:15108:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788448650.088329:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3308:x1875323926970368:12345-0@lo:8:kworker.0 Request processed in 39us (5466us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788448650.088335:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788448650.088863:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83cdfd180 x1875323926970240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448670 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448650.088889:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448650.088898:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1788448650.088908:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788448650.088913:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788448650.088916:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a83fc68000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788448650.088977:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788448650.088984:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926970240:0@lo:8:kworker.0 00000100:00080000:2.0:1788448650.089004:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788448650.089008:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788448650.089010:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926970368:0@lo:8:kworker.0 00000100:00100000:1.0:1788448650.093628:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926970752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448650.093718:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448650.093839:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970752 00000100:00100000:3.0:1788448650.093849:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970752 00000004:00080000:0.0:1788448650.093886:0:14442:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:3.0:1788448650.093906:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788448650.093917:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926970752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788448650.093952:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:0.0:1788448650.094232:0:14442:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510701045826ns, next at 0ns, rc = 0 00000100:00080000:0.0:1788448650.094286:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448650.096622:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1875323926970752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2699us (2895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448650.096636:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000004:00080000:2.0:1788448650.096685:0:14443:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1788448650.096737:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875323926970880:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788448650.096797:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448650.096828:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807434840 going to sleep for 11 seconds 00010000:00080000:1.0:1788448650.100431:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a704686a00 x1875323926970752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448666 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448650.100675:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926970752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448650.100727:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926970880 00000100:00100000:1.0:1788448650.100734:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926970880 00000100:00100000:1.0:1788448650.100781:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448650.100792:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14443:x1875323926970880:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788448650.107885:0:15108:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1788448650.107895:0:15108:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1788448650.107901:0:15108:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:1.0:1788448650.120262:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.120274:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120291:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.120297:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.120304:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120323:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120333:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120342:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120373:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.120387:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.120392:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120400:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.120404:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120413:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120429:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120437:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.120761:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.120764:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.120766:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.121655:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.121664:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121677:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.121765:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.121773:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121786:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121795:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121802:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121821:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.121833:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.121839:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121846:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.121851:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121860:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121872:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121889:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac01c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.121904:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.121906:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.121908:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.122336:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.122342:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122351:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.122355:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.122359:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122369:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122378:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122385:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122400:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.122409:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.122419:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122427:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9ce00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.122431:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122439:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122451:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122458:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122471:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.122473:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.122474:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.122902:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.122908:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122918:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.122921:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.122925:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122945:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122952:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122960:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122974:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.122983:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.122987:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.122993:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9ca00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.122996:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.123003:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.123013:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.123020:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac02a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.123038:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.123041:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.123043:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.124336:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.124346:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.124362:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.124366:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.124372:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.124384:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.124393:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.124400:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.124415:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.124425:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.124430:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.125123:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.125128:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.125137:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.125153:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.125160:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a9242d1a/0xd0e9b344b90ac031 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.125177:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.125179:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.125181:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.126824:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.126835:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126850:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.126854:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.126860:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126873:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126888:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126894:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126909:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.126918:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.126923:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126929:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.126934:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126943:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126958:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126966:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007a93411/0xd0e9b344b90ac038 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.126981:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.126987:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.126989:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.128904:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.128914:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.128929:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.128934:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.128939:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.128952:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.128961:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.128968:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.128988:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448650.129052:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448650.129060:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.129067:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448650.129072:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.129081:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.129100:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.129120:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000a80f687/0xd0e9b344b90ac03f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.129140:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.129142:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.129143:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.130773:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.130783:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.130795:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.130799:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.130804:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.130824:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.130832:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.130839:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.130862:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448650.130928:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448650.130935:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448650.130942:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448650.130947:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448650.130955:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448650.130983:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448650.130990:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000004e3b472/0xd0e9b344b90ac046 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448650.131006:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448650.131009:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448650.131011:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.132419:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.132429:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132771:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.132776:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.132782:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132796:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132806:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132824:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132849:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.132866:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.132871:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132879:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9ca00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.132884:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132892:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132907:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132914:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000379a4722/0xd0e9b344b90ac04d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.132931:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.132934:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.132935:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.133762:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.133776:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133788:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.133792:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.133797:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133808:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133816:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133822:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133842:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.133854:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.133858:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133866:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9ce00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.133872:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133880:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133898:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133905:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f2f70ab4/0xd0e9b344b90ac054 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.133918:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.133920:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.133922:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.134713:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.134721:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134732:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.134735:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.134740:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134751:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134760:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134768:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134795:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.134805:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.134810:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134816:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.134820:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134829:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134842:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134849:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d470950c/0xd0e9b344b90ac05b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.134863:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.134865:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.134866:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.136270:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.136281:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136294:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.136306:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.136311:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136324:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136333:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136341:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136357:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.136372:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.136377:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136383:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9d800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.136387:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136395:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136408:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136427:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e8c65be8/0xd0e9b344b90ac062 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.136535:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.136538:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.136540:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.138094:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.138104:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138117:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.138122:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.138126:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138138:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138147:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138154:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138169:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.138180:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.138208:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138215:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.138220:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138228:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138241:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138248:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000227d65c8/0xd0e9b344b90ac069 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138263:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.138265:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.138266:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.138708:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.138713:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138722:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.138726:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.138730:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138749:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138756:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138763:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138774:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.138783:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.138787:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138793:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9de00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.138796:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138803:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138813:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138820:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c46311c/0xd0e9b344b90ac070 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.138839:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.138840:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.138842:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.139254:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.139260:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139269:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.139273:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.139278:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139287:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139295:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139302:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139315:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448650.139705:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448650.139712:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.139720:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9dc00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.139724:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448650.139734:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.139740:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.139743:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139755:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=510s v=(0 0) 00010000:00010000:3.0:1788448650.139758:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139758:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.139763:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.139765:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000680e44c/0xd0e9b344b90ac077 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139773:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.139780:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.139780:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.139782:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.139784:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.139788:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.139812:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448650.140447:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448650.140454:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.140462:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83cc9c000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.140467:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.140475:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.140487:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.140517:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a8e5635/0xd0e9b344b90ac07e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.140533:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.140535:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.140537:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.145072:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.145087:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.145105:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.145109:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.145115:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.145130:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.145150:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.145158:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.145176:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448650.146343:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448650.146357:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.146371:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ece00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.146376:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.146387:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.146409:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.146417:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ffb1b4f7/0xd0e9b344b90ac085 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.146440:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.146442:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.146444:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.148024:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.148034:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148050:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.148055:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.148060:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148074:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148083:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148090:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148119:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.148131:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.148136:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148142:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eda00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.148147:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148156:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148170:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148178:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac08c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.148210:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.148212:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.148214:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.149936:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788448650.150158:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:1.0:1788448650.151651:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.151666:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151776:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.151781:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.151788:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151802:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151814:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151822:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151845:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.151861:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.151867:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151875:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ede00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.151881:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151890:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151918:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151927:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac093 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.151944:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.151946:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.151948:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.153986:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.154001:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.154017:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.154021:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.154028:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.154042:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.154052:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.154060:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.154101:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448650.154112:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448650.154119:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.154127:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed600 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448650.154132:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.154140:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.154155:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.154162:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030b919f0/0xd0e9b344b90ac09a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.154179:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.154181:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.154206:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.157968:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.157984:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158002:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.158006:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.158013:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158028:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158039:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158047:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158067:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.158084:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.158089:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158097:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.158107:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158117:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158133:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158141:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ac8579df/0xd0e9b344b90ac0a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.158160:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.158163:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.158165:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.159288:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.159296:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.159310:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.159314:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.159319:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.159331:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.159340:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.159354:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.159376:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448650.160247:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448650.160255:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.160265:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448650.160271:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.160279:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.160297:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.160304:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd857926/0xd0e9b344b90ac0a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448650.160321:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.160323:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.160325:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.162321:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.162335:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162352:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.162357:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.162363:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162378:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162387:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162394:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162412:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.162426:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.162432:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162448:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.162453:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162461:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162476:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162482:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecd46948/0xd0e9b344b90ac0af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.162509:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.162512:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.162513:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.163030:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.163036:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163045:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.163049:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.163053:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163062:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163076:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163082:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163094:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788448650.163495:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.163515:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163524:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.163527:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.163531:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163540:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163548:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163554:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.163582:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788448650.164012:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448650.164020:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164028:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.164032:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164040:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164054:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164061:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3c3c92e/0xd0e9b344b90ac0b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164077:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448650.164081:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164087:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ed200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.164090:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164098:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164123:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164129:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069b7be2/0xd0e9b344b90ac0bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.164141:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.164143:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.164145:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.165076:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.165086:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.165100:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.165104:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.165109:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.165121:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.165129:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.165137:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.165161:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448650.166798:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448650.166811:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.166825:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ede00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448650.166830:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.166841:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.166861:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.166869:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068f2458d/0xd0e9b344b90ac0c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448650.166905:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.166907:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448650.166910:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788448650.167832:0:15108:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1788448650.167846:0:15108:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167863:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=510s v=(0 0) 00010000:00010000:1.0:1788448650.167874:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448650.167880:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167894:0:15108:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167903:0:15108:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167911:0:15108:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167931:0:15108:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448650.167945:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448650.167949:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167956:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eda00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448650.167960:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167969:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167981:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.167999:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b224a4dd/0xd0e9b344b90ac0cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448650.168015:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.168017:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448650.168018:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448650.168071:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788448650.168310:0:15108:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:1.0:1788448650.168410:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14443:x1875323926970880:12345-0@lo:5:osp-pre-0-0.0 Request processed in 67616us (71608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448650.168419:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788448650.168743:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875323926970880:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1788448650.168759:0:14443:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:0.0:1788448650.168809:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875323926971008:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1788448650.168845:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448650.168897:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448650.169567:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971008 00000100:00100000:1.0:1788448650.169575:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971008 00000100:00100000:1.0:1788448650.169625:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448650.169635:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14443:x1875323926971008:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788448650.169678:0:15106:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1788448650.170465:0:15107:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788448650.170476:0:15107:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1788448650.182462:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14443:x1875323926971008:12345-0@lo:5:osp-pre-0-0.0 Request processed in 12822us (13610us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788448650.182474:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448650.182546:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14443:1875323926971008:0@lo:5:osp-pre-0-0.0 00000004:00080000:1.0:1788448650.182561:0:14443:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:1.0:1788448651.168851:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448652.195081:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788448652.499555:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788448652.499615:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1788448653.217393:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448654.240573:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448655.269012:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448655.458951:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926971136:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448655.459037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448655.459165:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971136 00000100:00100000:0.0:1788448655.459173:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971136 00000100:00100000:0.0:1788448655.459259:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448655.459269:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926971136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448655.459306:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448655.459356:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926971136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448655.459364:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788448655.459386:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448655.459454:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788448655.459477:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926971136:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1788448655.462488:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788448655.462495:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788448655.462498:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788448655.462507:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 510 00000100:00080000:2.0:1788448655.462512:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788448655.462518:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:2.0:1788448655.462541:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a704684380 x1875323926971392/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788448655.462716:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926971392:0@lo:8:kworker.0 00000100:00100000:2.0:1788448655.462910:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448655.463446:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926971648:0@lo:400:kworker.0 00000100:00100000:1.0:1788448655.463500:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448655.463633:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971648 00000100:00100000:1.0:1788448655.463641:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971648 00000100:00100000:1.0:1788448655.463709:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788448655.463720:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926971648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448655.463778:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926971648:12345-0@lo:400:kworker.0 Request processed in 61us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448655.463786:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788448655.463814:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448655.463857:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a704687480 x1875323926971648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448655.463874:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926971648:0@lo:400:kworker.0 00000100:00100000:0.0:1788448655.464085:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926971264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448655.464122:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448655.464153:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448655.464160:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926971520:0@lo:400:kworker.0 00000100:00100000:0.0:1788448655.464205:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448655.464240:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971392 00000100:00100000:0.0:1788448655.464244:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971392 00000100:00100000:0.0:1788448655.464267:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788448655.464272:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875323926971392:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1788448655.464291:0:15107:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788448655.465685:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971520 00000100:00100000:1.0:1788448655.465699:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971520 00000100:00100000:1.0:1788448655.465748:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448655.465757:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926971520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448655.465838:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926971520:12345-0@lo:400:kworker.0 Request processed in 83us (1653us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448655.465845:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448655.465872:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971264 00000100:00100000:1.0:1788448655.465875:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971264 00000100:00100000:1.0:1788448655.465902:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788448655.465918:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:3309:x1875323926971264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448655.465952:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:3309:x1875323926971264:12345-0@lo:400:kworker.0 Request processed in 36us (1829us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448655.465960:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1788448655.467791:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a704684e00 x1875323926971520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448671 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448655.467809:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926971520:0@lo:400:kworker.0 00000100:00100000:1.0:1788448655.467821:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926971264:0@lo:400:kworker.0 00000100:00100000:0.0:1788448655.501909:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875323926971392:12345-0@lo:8:kworker.0 Request processed in 37622us (38986us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788448655.501925:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1788448655.502092:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788448655.502099:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788448655.502103:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926971392:0@lo:8:kworker.0 00010000:00010000:1.0:1788448656.290131:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788448656.470096:0:15825:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788448656.470100:0:15825:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1788448656.470622:0:15825:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff99a7073be800 00000020:01000004:3.0:1788448656.470643:0:15825:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788448656.470659:0:15825:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1788448656.470676:0:15825:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff99a802d83370) 00000020:00000080:3.0:1788448656.470694:0:15825:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1788448656.490260:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1788448656.490714:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1788448656.491682:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1788448656.497574:0:15825:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1788448656.497865:0:15825:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1788448656.498684:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 229: rc = 0 00100000:10000000:2.0:1788448656.498807:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 229: rc = 0 00100000:10000000:2.0:1788448656.498976:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 229: rc = 0 00100000:10000000:2.0:1788448656.499766:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1788448656.500025:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 646: rc = 0 00100000:10000000:2.0:1788448656.500558:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 646: rc = 0 00100000:10000000:2.0:1788448656.500919:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1788448656.501163:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 646: rc = 0 00100000:10000000:2.0:1788448656.501436:0:15825:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 646: rc = 0 00000020:00000080:3.0:1788448656.502467:0:15825:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788448656.502481:0:15825:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788448656.502557:0:15825:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd0e9b344b90ac0d9 00000020:01000004:3.0:1788448656.502566:0:15825:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1788448656.502593:0:15825:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.137@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788448656.502596:0:15825:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.137@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788448656.502602:0:15825:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788448656.502626:0:15825:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1788448656.502631:0:15825:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.137@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1788448656.515323:0:15825:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.137@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788448656.515360:0:15825:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.137@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1788448656.515365:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788448656.515367:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448656.515368:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448656.515369:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448656.515390:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448656.515391:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448656.515392:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448656.515394:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448656.515395:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448656.515398:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1788448656.515400:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788448656.515401:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448656.515402:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448656.515403:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448656.515404:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448656.515405:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448656.515406:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448656.515407:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448656.515407:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788448656.515433:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1788448656.515455:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926971776:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788448656.515764:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.515888:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2180 going to sleep for 11 seconds 00000100:00100000:0.0:1788448656.515985:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971776 00000100:00100000:0.0:1788448656.515993:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971776 00000100:00100000:0.0:1788448656.516091:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788448656.516108:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:15825:x1875323926971776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788448656.516151:0:14414:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788448656.516155:0:14414:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788448656.516159:0:14414:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788448656.526462:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:15825:x1875323926971776:12345-0@lo:253:mount.lustre.0 Request processed in 10346us (10689us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.526478:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788448656.526621:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926971776:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788448656.526637:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788448656.526641:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788448656.526642:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788448656.526644:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788448656.526645:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788448656.526646:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788448656.526647:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788448656.526648:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788448656.526650:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788448656.526651:0:15825:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788448656.526671:0:15825:0:(tgt_mount.c:101:server_register_mount()) register mount ffff99a7073be800 from lustre-OST0001 10000000:01000000:3.0:1788448656.526700:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788448656.526703:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788448656.526710:0:15825:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff99a83e70cd28 local copy 00010000:00010000:3.0:1788448656.526722:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448656.527078:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926971904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448656.527117:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.527244:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788448656.527654:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926971904 00000100:00100000:1.0:1788448656.527663:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926971904 00000100:00100000:1.0:1788448656.527753:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788448656.527764:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15825:x1875323926971904:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448656.527981:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+16:15825:x1875323926971904:12345-0@lo:501:mount.lustre.0 Request processed in 217us (860us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788448656.527989:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788448656.528079:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926971904:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788448656.528103:0:15825:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.137@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788448656.528294:0:15825:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.137@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788448656.528302:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.528312:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810629e00/0xd0e9b344b90abe86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90abe8d expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448656.528349:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff99a7073be800 10000000:01000000:2.0:1788448656.528355:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788448656.528359:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1788448656.528361:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788448656.528365:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1788448656.528367:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788448656.528402:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.528417:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.528427:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448656.528445:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972032:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788448656.528477:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448656.528778:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80463c900 going to sleep for 11 seconds 00000100:00100000:3.0:1788448656.528868:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972032 00000100:00100000:3.0:1788448656.528874:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972032 00000100:00100000:3.0:1788448656.528905:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788448656.528913:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+16:15825:x1875323926972032:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448656.528925:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448656.528938:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a83fc38400/0xd0e9b344b90ac0e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac0e0 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.528959:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a83fc38400/0xd0e9b344b90ac0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac0e0 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.528969:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a83fc38400/0xd0e9b344b90ac0e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac0e0 expref: 17 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.528978:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a83fc38400, rc 0) 00000100:00100000:3.0:1788448656.529019:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972032:12345-0@lo:101:mount.lustre.0 Request processed in 107us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.529026:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788448656.529107:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972032:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448656.529121:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac0e7 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.529130:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac0e7 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448656.529772:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1788448656.530650:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448656.530901:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1788448656.530942:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1788448656.530971:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1788448656.531013:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1788448656.531047:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1788448656.531077:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1788448656.531138:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1788448656.531146:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1788448656.531243:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972160:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448656.531298:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448656.531332:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079af0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448656.531610:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972160 00000100:00100000:3.0:1788448656.531618:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972160 00000100:00100000:3.0:1788448656.531658:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788448656.531667:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972160:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448656.531999:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972160:12345-0@lo:501:mount.lustre.0 Request processed in 332us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.532013:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788448656.532158:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448656.532663:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972288:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448656.532710:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.532787:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448656.532821:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972288 00000100:00100000:0.0:1788448656.532826:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972288 00000100:00100000:0.0:1788448656.532903:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788448656.532912:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972288:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788448656.533332:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972288:12345-0@lo:503:mount.lustre.0 Request processed in 421us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.533341:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1788448656.533430:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704685500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972288:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788448656.534385:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788448656.534558:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972416:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448656.534619:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.534866:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2300 going to sleep for 11 seconds 00000100:00100000:1.0:1788448656.534942:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972416 00000100:00100000:1.0:1788448656.534950:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972416 00000100:00100000:1.0:1788448656.534992:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788448656.535004:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972416:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.535289:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972416:12345-0@lo:502:mount.lustre.0 Request processed in 286us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.535296:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788448656.535462:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972416:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448656.536031:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:3.0:1788448656.536077:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:3.0:1788448656.536104:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:3.0:1788448656.536146:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:3.0:1788448656.536178:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:3.0:1788448656.536321:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:3.0:1788448656.536364:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:3.0:1788448656.536407:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:3.0:1788448656.536444:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:3.0:1788448656.536483:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972544:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788448656.536636:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.536670:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2300 going to sleep for 11 seconds 00000100:00100000:0.0:1788448656.536736:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972544 00000100:00100000:0.0:1788448656.536743:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972544 00000100:00100000:0.0:1788448656.536779:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788448656.536788:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448656.536951:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972544:12345-0@lo:502:mount.lustre.0 Request processed in 163us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.536958:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788448656.537052:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972544:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448656.537119:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788448656.537129:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:1.0:1788448656.538106:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788448656.538116:0:15826:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:1.0:1788448656.538130:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.538133:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788448656.538140:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788448656.538158:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff99a704c5b370) 00000020:00000080:1.0:1788448656.538182:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788448656.538222:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788448656.538291:0:15826:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a7073be800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788448656.538299:0:15826:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788448656.538307:0:15826:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xd0e9b344b90ac0f5 00010000:00010000:1.0:1788448656.542706:0:15826:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:1.0:1788448656.543366:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1788448656.545592:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1788448656.548447:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1788448656.548467:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.548485:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.548573:0:15826:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1788448656.548578:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448656.548600:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.548603:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788448656.548607:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788448656.548622:0:15826:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788448656.548626:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.548628:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.548638:0:15826:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788448656.548641:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448656.548644:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.548645:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788448656.548649:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788448656.548743:0:15826:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.548747:0:15826:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.548748:0:15826:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788448656.548751:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1788448656.553384:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1788448656.553442:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788448656.554663:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac0e7 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.554678:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810628600/0xd0e9b344b90ac0e0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac0e7 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448656.554687:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a7073be800 from 1 10000000:01000000:3.0:1788448656.554690:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448656.554729:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.554737:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.554748:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448656.554773:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788448656.554841:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.554890:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.557914:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972672 00000100:00100000:2.0:1788448656.557931:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972672 00000100:00100000:2.0:1788448656.558043:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788448656.558070:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:15825:x1875323926972672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448656.558088:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448656.558124:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac0fc expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.558157:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.558168:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.558204:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629000, rc 0) 00000100:00100000:2.0:1788448656.558282:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926972672:12345-0@lo:101:mount.lustre.0 Request processed in 213us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.558289:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788448656.558409:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788448656.558430:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448656.558440:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788448656.559170:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1788448656.559638:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788448656.559901:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1788448656.559960:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1788448656.560081:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1788448656.560092:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1788448656.560163:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448656.560245:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.560278:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.560806:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972800 00000100:00100000:2.0:1788448656.560816:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972800 00000100:00100000:2.0:1788448656.560869:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788448656.560880:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926972800:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448656.561109:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926972800:12345-0@lo:501:mount.lustre.0 Request processed in 230us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.561118:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788448656.561345:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972800:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788448656.561398:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972928:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448656.561438:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.561505:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a704ec2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.564059:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926972928 00000100:00100000:2.0:1788448656.564084:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926972928 00000100:00100000:3.0:1788448656.567503:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788448656.567518:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926972928:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788448656.567827:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926972928:12345-0@lo:503:mount.lustre.0 Request processed in 312us (6386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.567835:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788448656.568107:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926972928:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448656.569768:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448656.569855:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973056:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.569944:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.569992:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808acc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.570085:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973056 00000100:00100000:2.0:1788448656.570092:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973056 00000100:00100000:2.0:1788448656.570140:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788448656.570150:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926973056:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448656.570383:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926973056:12345-0@lo:502:mount.lustre.0 Request processed in 225us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.570391:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788448656.571003:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973056:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448656.571681:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1788448656.571746:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1788448656.571797:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1788448656.571837:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1788448656.571869:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1788448656.571914:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1788448656.571948:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1788448656.571980:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1788448656.572020:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973184:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.572080:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.572157:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808acc540 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.572564:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973184 00000100:00100000:2.0:1788448656.572572:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973184 00000100:00100000:0.0:1788448656.572720:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788448656.572731:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926973184:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788448656.572946:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926973184:12345-0@lo:502:mount.lustre.0 Request processed in 216us (865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.572955:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788448656.573050:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973184:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448656.573172:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1788448656.573222:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1788448656.574345:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448656.574356:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574359:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788448656.574365:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a7073be800 00000020:00000080:1.0:1788448656.574368:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448656.574388:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.574391:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574392:0:15830:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788448656.574395:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448656.574405:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574406:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788448656.574411:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff99a7073be800 00000020:00000080:1.0:1788448656.574413:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448656.574467:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.574472:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574473:0:15830:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788448656.574475:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788448656.574478:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574480:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788448656.574483:0:15830:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff99a7073be800 00000020:00000080:1.0:1788448656.574485:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788448656.574535:0:15830:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788448656.574539:0:15830:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788448656.574540:0:15830:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1788448656.574543:0:15830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1788448656.574585:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1788448656.574607:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788448656.574625:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.574637:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788448656.574689:0:15825:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788448656.574692:0:15825:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff99a7073be800 10000000:01000000:1.0:1788448656.574695:0:15825:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff99a7073be800 10000000:01000000:1.0:1788448656.574699:0:15825:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788448656.574705:0:15825:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff99a7073be800 from 1 10000000:01000000:1.0:1788448656.574708:0:15825:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788448656.574745:0:15825:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.574763:0:15825:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.574775:0:15825:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448656.574801:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973312:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788448656.574868:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.578327:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.579151:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973312 00000100:00100000:2.0:1788448656.579162:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973312 00000100:00100000:2.0:1788448656.579240:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788448656.579251:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926973312:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788448656.579267:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448656.579284:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629400/0xd0e9b344b90ac111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac10a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.579311:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629400/0xd0e9b344b90ac111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac10a expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.579323:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629400/0xd0e9b344b90ac111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac10a expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.579333:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629400, rc 0) 00000100:00100000:2.0:1788448656.579412:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973312:12345-0@lo:101:mount.lustre.0 Request processed in 164us (4543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.579419:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788448656.579655:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973312:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788448656.579674:0:15825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac111 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.579684:0:15825:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac111 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448656.580315:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:1.0:1788448656.580750:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788448656.581005:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788448656.581052:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788448656.581086:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788448656.581134:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788448656.581274:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788448656.581335:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788448656.581382:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788448656.581424:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788448656.581475:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788448656.582825:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788448656.582895:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788448656.582964:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788448656.583021:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788448656.583054:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788448656.583113:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788448656.583153:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788448656.584972:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788448656.585104:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788448656.585149:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788448656.585182:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788448656.585280:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788448656.585320:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788448656.585350:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788448656.587352:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788448656.587441:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1788448656.587477:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1788448656.588698:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1788448656.588749:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1788448656.588805:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1788448656.588860:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:1.0:1788448656.588898:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:1.0:1788448656.588934:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:1.0:1788448656.588972:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:1.0:1788448656.589021:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:1.0:1788448656.589062:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:1.0:1788448656.589107:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:1.0:1788448656.589144:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:1.0:1788448656.589276:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:1.0:1788448656.589285:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:1.0:1788448656.589404:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448656.589479:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.592651:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.592754:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973440 00000100:00100000:2.0:1788448656.592769:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973440 00000100:00100000:2.0:1788448656.592832:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788448656.592842:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973440:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788448656.593128:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973440:12345-0@lo:501:mount.lustre.0 Request processed in 287us (3648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.593136:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788448656.593635:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973440:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788448656.593686:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973568:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788448656.593731:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.593758:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.593820:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973568 00000100:00100000:2.0:1788448656.593825:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973568 00000100:00100000:2.0:1788448656.593854:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1788448656.593862:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7045e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973568:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788448656.594023:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7045e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973568:12345-0@lo:503:mount.lustre.0 Request processed in 161us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.594031:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788448656.596048:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973568:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788448656.596939:0:15825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788448656.597019:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.597087:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.597130:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973696 00000100:00100000:1.0:1788448656.597137:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973696 00000100:00100000:1.0:1788448656.597204:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448656.597215:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973696:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.597427:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973696:12345-0@lo:502:mount.lustre.0 Request processed in 213us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.597435:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788448656.599626:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448656.603442:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788448656.604617:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1788448656.604689:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1788448656.604722:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1788448656.604782:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1788448656.604818:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1788448656.604864:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1788448656.604898:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1788448656.604931:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1788448656.604979:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1788448656.605079:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1788448656.605128:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1788448656.605178:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1788448656.605251:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1788448656.605285:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1788448656.605333:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1788448656.605369:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1788448656.605420:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1788448656.605471:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1788448656.606383:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1788448656.606446:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1788448656.607631:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1788448656.607711:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1788448656.607744:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1788448656.607815:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1788448656.607853:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1788448656.607902:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1788448656.607949:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1788448656.607988:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1788448656.608021:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1788448656.608070:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1788448656.608106:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1788448656.608142:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1788448656.608175:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1788448656.608276:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1788448656.608318:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1788448656.608395:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1788448656.608432:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1788448656.608466:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1788448656.610700:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1788448656.610777:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1788448656.610833:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973824:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788448656.611366:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448656.612940:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448656.614838:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973824 00000100:00100000:2.0:1788448656.614850:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973824 00000100:00100000:2.0:1788448656.614908:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788448656.614918:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788448656.615229:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926973824:12345-0@lo:502:mount.lustre.0 Request processed in 312us (3865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.615238:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788448656.615416:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926973824:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788448656.615630:0:15825:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1788448656.615647:0:15825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1788448656.621022:0:15835:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788448656.621041:0:15835:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff99a802d819b8) 00000020:00000080:3.0:1788448656.621064:0:15835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1788448656.621159:0:15835:0:(tgt_mount.c:153:server_get_mount()) get mount ffff99a7073be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788448656.621164:0:15835:0:(tgt_mount.c:187:server_put_mount()) put mount ffff99a7073be800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788448656.621167:0:15835:0:(obd_mount.c:710:lustre_put_lsi()) put ffff99a7073be800 3 00010000:00080000:3.0:1788448656.621232:0:15835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff99a70558c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.137@tcp at head 00010000:00010000:3.0:1788448656.623574:0:15835:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1788448656.623833:0:15835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788448656.623873:0:15835:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788448656.623886:0:15835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xd0e9b344b90ac11f 00000100:00080000:3.0:1788448656.623897:0:15835:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788448656.623903:0:15835:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff99a70558c800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:3.0:1788448656.623939:0:15835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83563aa00 x1875323926973952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788448656.623973:0:15835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788448656.624050:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926973952:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788448656.624123:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448656.624581:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926973952 00000100:00100000:3.0:1788448656.624590:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926973952 00000100:00100000:3.0:1788448656.624635:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788448656.624643:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3308:x1875323926973952:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788448656.624667:0:14421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 517 last 0 00000020:00000080:3.0:1788448656.624700:0:14421:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xd0e9b344b90ac126 00000004:00100000:3.0:1788448656.624715:0:14421:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788448656.624745:0:14421:0:(import.c:65:import_set_state_nolock()) ffff99a70558a000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448656.624799:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1875323926973952:12345-0@lo:38:llog_process_th.0 Request processed in 156us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.624806:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:3.0:1788448656.624936:0:15835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:0.0:1788448656.625256:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788448656.625261:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788448656.625263:0:38:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788448656.625268:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 516 00000100:00080000:0.0:1788448656.625271:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1788448656.625275:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:0.0:1788448656.625293:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83cdfd500 x1875323926974208/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788448656.625344:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448656.625354:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926974080:0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625404:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448656.625437:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926974336:0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625462:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448656.625482:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788448656.625554:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926974464:0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625578:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448656.625610:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974080 00000100:00100000:0.0:1788448656.625614:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974080 00000100:00100000:0.0:1788448656.625656:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448656.625664:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926974080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625705:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926974080:12345-0@lo:400:kworker.0 Request processed in 42us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.625711:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448656.625731:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974336 00000100:00100000:0.0:1788448656.625734:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974336 00000100:00100000:0.0:1788448656.625751:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974464 00000100:00100000:0.0:1788448656.625753:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974464 00000100:00100000:0.0:1788448656.625780:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448656.625786:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926974336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625821:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926974336:12345-0@lo:400:kworker.0 Request processed in 36us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.625827:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788448656.625839:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448656.625846:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926974464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448656.625872:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926974464:12345-0@lo:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448656.625879:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448656.625922:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926974080:0@lo:400:kworker.0 00010000:00080000:0.0:1788448656.625951:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83cdfd180 x1875323926974464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448656.625961:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926974464:0@lo:400:kworker.0 00010000:00080000:0.0:1788448656.625971:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83cdff480 x1875323926974336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448672 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788448656.625979:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926974336:0@lo:400:kworker.0 00000100:00100000:2.0:1788448656.626067:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926974208:0@lo:8:kworker.0 00000100:00100000:2.0:1788448656.626097:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788448656.626130:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff99a83563aa00 x1875323926973952/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788448666 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788448656.626152:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788448656.626161:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1788448656.626169:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788448656.626173:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788448656.626176:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a70558c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788448656.626182:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3308:1875323926973952:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788448656.627594:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974208 00000100:00100000:0.0:1788448656.627604:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974208 00000100:00100000:0.0:1788448656.627648:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448656.627655:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875323926974208:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788448656.627732:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3308:x1875323926974208:12345-0@lo:8:kworker.0 Request processed in 76us (1633us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788448656.627739:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788448656.627781:0:3308:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788448656.627799:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788448656.627803:0:3308:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788448656.627807:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926974208:0@lo:8:kworker.0 00000020:01000000:0.0:1788448656.628280:0:15825:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1788448656.628318:0:15825:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788448656.628369:0:15825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac111 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.628391:0:15825:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092eca00/0xd0e9b344b90ac10a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac111 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788448656.628442:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788448656.628445:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448656.628446:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448656.628448:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448656.628449:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448656.628450:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448656.628452:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448656.628454:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448656.628455:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448656.628459:0:15825:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788448656.628462:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788448656.628463:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448656.628464:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448656.628465:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448656.628466:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448656.628467:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448656.628469:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448656.628470:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448656.628471:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788448656.628503:0:15825:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788448656.628523:0:15825:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926974592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788448656.628573:0:15825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448656.628609:0:15825:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788448656.630309:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974592 00000100:00100000:1.0:1788448656.630322:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974592 00000100:00100000:1.0:1788448656.630391:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788448656.630402:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:15825:x1875323926974592:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788448656.630446:0:14413:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788448656.630463:0:14413:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788448656.654659:0:14413:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788448656.654678:0:14413:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1788448656.654802:0:14436:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788448656.654808:0:14436:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788448656.654831:0:14436:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.654850:0:14436:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.654858:0:14436:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.654899:0:14436:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 19 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.654915:0:14436:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 19 pid: 14413 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448656.654931:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926974720:0@lo:104: 00000100:00100000:2.0:1788448656.654999:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448656.655080:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808bc5000 going to sleep for 11 seconds 00000100:00100000:1.0:1788448656.655848:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974720 00000100:00100000:1.0:1788448656.655858:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974720 00000100:00100000:1.0:1788448656.655912:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788448656.655923:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926974720:12345-0@lo:104: 00010000:00010000:1.0:1788448656.655938:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448656.656012:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788448656.656019:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:14436:x1875323926974720:12345-0@lo:104: Request processed in 98us (1019us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448656.656026:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788448656.656111:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14436:1875323926974720:0@lo:104: 00010000:00010000:0.0:1788448656.656138:0:14436:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656325:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448656.656331:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656339:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:0.0:1788448656.656343:0:14409:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656352:0:14409:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788448656.656359:0:14409:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448656.656365:0:14409:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788448656.656416:0:14409:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656423:0:14409:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788448656.656451:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656458:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810759600/0xd0e9b344b90ac000 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac007 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.656477:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448656.656479:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448656.656583:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926974848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448656.656638:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448656.656684:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974848 00000100:00100000:2.0:1788448656.656689:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974848 00010000:00010000:2.0:1788448656.656708:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 20 pid: 14413 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448656.656732:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448656.656739:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961e328-478c-41d0-979d-0dab1f06ac13+20:3311:x1875323926974848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788448656.656750:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448656.656756:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 20 pid: 14413 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656766:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 20 pid: 14413 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656779:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc38800/0xd0e9b344b90ac007 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90ac000 expref: 20 pid: 14413 timeout: 617 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656793:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656800:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788448656.656814:0:14408:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.012688060s 00010000:00010000:2.0:1788448656.656818:0:14408:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656825:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656842:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656848:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656855:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448656.656859:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656868:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656883:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448656.656891:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448656.656923:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926974848:12345-0@lo:103:ldlm_bl.0 Request processed in 185us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448656.656930:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448656.656958:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926974848:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448656.657000:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448656.657010:0:14436:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.657018:0:14436:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448656.657024:0:14436:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629200/0xd0e9b344b90ac12d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14436 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448656.662916:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+18:15825:x1875323926974592:12345-0@lo:253:mount.lustre.0 Request processed in 32508us (34335us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448656.662931:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788448656.663102:0:15825:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5961e328-478c-41d0-979d-0dab1f06ac13:15825:1875323926974592:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788448656.663119:0:15825:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788448656.663122:0:15825:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788448656.663124:0:15825:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788448656.663125:0:15825:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788448656.663127:0:15825:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788448656.663128:0:15825:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788448656.663129:0:15825:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788448656.663131:0:15825:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788448656.663133:0:15825:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788448656.663134:0:15825:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788448656.663147:0:15825:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1788448656.667824:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448656.668091:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448656.668254:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448656.668412:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1788448656.668763:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1788448656.668972:0:15825:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1788448656.669961:0:15825:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788448656.723352:0:15825:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788448656.723363:0:15825:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788448656.723409:0:15825:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788448656.723473:0:15825:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.137@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788448656.723593:0:15825:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788448656.723857:0:15825:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1788448657.313706:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448658.339552:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788448658.656284:0:14417:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788448658.656293:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff99a70705f000 from 8 10000000:01000000:1.0:1788448658.656298:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788448658.656354:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.656372:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448658.656384:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448658.656413:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926974976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788448658.656485:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448658.656540:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807887f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448658.656598:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926974976 00000100:00100000:2.0:1788448658.656607:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926974976 00000100:00100000:2.0:1788448658.656664:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788448658.656675:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926974976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448658.656688:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448658.656702:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810629a00/0xd0e9b344b90ac13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac134 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448658.656730:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810629a00/0xd0e9b344b90ac13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac134 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448658.656751:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810629a00/0xd0e9b344b90ac13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac134 expref: 19 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448658.656761:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810629a00, rc 0) 00000100:00100000:2.0:1788448658.656818:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926974976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 145us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.656825:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788448658.656971:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926974976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448658.656986:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac13b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448658.656995:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac13b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448658.657042:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926975104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788448658.657073:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448658.657097:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a8079af6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448658.657137:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975104 00000100:00100000:2.0:1788448658.657141:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975104 00000100:00100000:2.0:1788448658.657169:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788448658.657176:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926975104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788448658.657217:0:14413:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788448658.657234:0:14413:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788448658.657237:0:14413:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788448658.657315:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926975104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 139us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448658.657322:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788448658.657415:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926975104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788448658.657474:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788448658.657481:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac13b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448658.657488:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a8092ed400/0xd0e9b344b90ac134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac13b expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788448658.723816:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788448659.365232:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448660.384402:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448660.580111:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926975232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448660.580199:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448660.580332:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975232 00000100:00100000:1.0:1788448660.580340:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975232 00000100:00100000:1.0:1788448660.580404:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448660.580415:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926975232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448660.580450:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448660.580500:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926975232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448660.580508:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788448660.580556:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926975232:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448660.580609:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788448661.409131:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788448662.112707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788448662.112714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788448662.112718:0:8:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788448662.112731:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff99a829498800 using connection 192.168.204.137@tcp/0@lo 00000100:00100000:1.0:1788448662.112759:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff99a83d2e7480 x1875323926975616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788448662.112807:0:3308:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926975616:0@lo:8:kworker.0 00000100:00100000:1.0:1788448662.112965:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926975360:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113001:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448662.113044:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926976000:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113072:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448662.113096:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448662.113101:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926975488:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113129:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926975744:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113149:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448662.113166:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448662.113171:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926975872:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113219:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448662.113248:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976000 00000100:00100000:1.0:1788448662.113256:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976000 00000100:00100000:3.0:1788448662.113276:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448662.113311:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975616 00000100:00100000:1.0:1788448662.113311:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975744 00000100:00100000:3.0:1788448662.113315:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975616 00000100:00100000:1.0:1788448662.113315:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975744 00000100:00100000:1.0:1788448662.113327:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975872 00000100:00100000:1.0:1788448662.113329:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975872 00000100:00100000:3.0:1788448662.113345:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448662.113345:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788448662.113352:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3308:x1875323926975616:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1788448662.113352:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926976000:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788448662.113375:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 522 last 0 00000100:00100000:1.0:1788448662.113396:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1875323926976000:12345-0@lo:400:kworker.0 Request processed in 44us (322us total) trans 0 rc 0/0 00000020:00000080:3.0:1788448662.113402:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xd0e9b344b90ac142 00000100:00100000:1.0:1788448662.113403:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00002000:00100000:3.0:1788448662.113415:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff99a70558f800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113967 ocd_grant: 0 ocd_index: 1 ocd_group 0 00000100:00100000:1.0:1788448662.113418:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00002000:00080000:3.0:1788448662.113420:0:15106:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1788448662.113422:0:15106:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1788448662.113424:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926975744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113450:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926975744:12345-0@lo:400:kworker.0 Request processed in 27us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448662.113461:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448662.113473:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788448662.113478:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926975872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113502:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926975872:12345-0@lo:400:kworker.0 Request processed in 24us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448662.113508:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788448662.113538:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788448662.113566:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e7800 x1875323926975872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448662.113579:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926975872:0@lo:400:kworker.0 00010000:00080000:1.0:1788448662.113590:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e6680 x1875323926975744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448662.113598:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926975744:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113622:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788448662.113648:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e6d80 x1875323926976000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788448678 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788448662.113656:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3309:1875323926976000:0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113674:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975488 00000100:00100000:1.0:1788448662.113677:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975488 00000100:00100000:1.0:1788448662.113705:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788448662.113712:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926975488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448662.113744:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926975488:12345-0@lo:400:kworker.0 Request processed in 33us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448662.113750:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788448662.113770:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448662.113786:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926975488:0@lo:400:kworker.0 00000100:00100000:2.0:1788448662.114252:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926975360 00000100:00100000:2.0:1788448662.114257:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926975360 00000100:00100000:2.0:1788448662.114296:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788448662.114303:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:3309:x1875323926975360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448662.114343:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:3309:x1875323926975360:12345-0@lo:400:kworker.0 Request processed in 41us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448662.114349:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00002000:00080000:3.0:1788448662.114422:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788448662.114446:0:15106:0:(import.c:65:import_set_state_nolock()) ffff99a70558f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448662.114483:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3308:x1875323926975616:12345-0@lo:8:kworker.0 Request processed in 1132us (1535us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448662.114491:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788448662.114535:0:3308:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a83d2e7480 x1875323926975616/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788448687 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788448662.114549:0:3308:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788448662.114556:0:3308:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788448662.114561:0:3308:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788448662.114563:0:3308:0:(import.c:65:import_set_state_nolock()) ffff99a829498800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788448662.114685:0:3308:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788448662.114692:0:3308:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3308:1875323926975616:0@lo:8:kworker.0 00000004:00080000:3.0:1788448662.114715:0:14444:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:1.0:1788448662.115706:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5961e328-478c-41d0-979d-0dab1f06ac13:3309:1875323926975360:0@lo:400:kworker.0 00000004:00080000:3.0:1788448662.117814:0:14444:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 522724625452ns, next at 0ns, rc = 0 00000100:00100000:2.0:1788448662.118678:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926976128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448662.118821:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448662.118881:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976128 00000100:00100000:2.0:1788448662.118889:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976128 00000100:00100000:2.0:1788448662.119170:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788448662.119181:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926976128:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1788448662.119244:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:3.0:1788448662.119728:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448662.119794:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926976128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 614us (971us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448662.119802:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788448662.119927:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff99a704686680 x1875323926976128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788448678 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788448662.120288:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926976128:0@lo:13:osp-pre-1-0.0 00000004:00080000:2.0:1788448662.120543:0:14445:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788448662.120577:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875323926976256:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788448662.120620:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448662.120644:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807434000 going to sleep for 11 seconds 00000100:00100000:3.0:1788448662.121334:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976256 00000100:00100000:3.0:1788448662.121343:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976256 00000100:00100000:3.0:1788448662.121395:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788448662.121406:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14445:x1875323926976256:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788448662.129235:0:15107:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1788448662.129246:0:15107:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788448662.129252:0:15107:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:3.0:1788448662.143759:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.143772:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.143790:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.143796:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.143803:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.143821:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.143833:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.143840:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.143873:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788448662.144654:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448662.144662:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.144672:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.144678:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.144702:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.144725:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448662.146364:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.146375:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146391:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.146396:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.146402:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146416:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146426:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146434:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146454:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788448662.146881:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.146887:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146896:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.146905:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.146911:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146922:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146931:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146938:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.146948:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788448662.147429:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.147434:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.147443:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.147445:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.147449:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.147458:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.147465:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.147477:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.147486:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1788448662.147778:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac149 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.147961:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788448662.147970:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148037:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788448662.148059:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38a00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448662.148065:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148085:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148107:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148114:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8041d4/0xd0e9b344b90ac150 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148133:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448662.148137:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148143:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448662.148147:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148161:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148172:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148179:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000439c258a/0xd0e9b344b90ac15e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.148218:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448662.148220:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448662.148223:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.148770:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.148775:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.148778:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.148812:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148823:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.148827:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148836:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148851:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148859:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b4fd67a6/0xd0e9b344b90ac157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.148885:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.148887:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.148889:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.151353:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.151367:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.151385:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.151389:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.151396:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.151411:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.151422:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.151429:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.151452:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788448662.151542:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788448662.151551:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.151561:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:1.0:1788448662.151567:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.151577:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.151595:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.151616:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000043462158/0xd0e9b344b90ac165 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448662.151640:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448662.151642:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788448662.151645:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1788448662.152943:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:3.0:1788448662.152982:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.152992:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153012:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.153016:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.153023:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153040:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153049:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153057:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153084:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448662.153094:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448662.153099:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153107:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.153112:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153119:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153146:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153154:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096019a99/0xd0e9b344b90ac16c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153170:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.153172:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.153174:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.153643:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.153650:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153659:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.153663:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.153668:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153678:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153686:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153694:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.153720:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448662.153729:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448662.156793:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.156812:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.156816:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.156828:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.156849:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.156857:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4b9532a/0xd0e9b344b90ac173 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.156881:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.156883:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.156886:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.157489:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.157496:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157507:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.157518:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.157525:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157538:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157547:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157554:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157580:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448662.157593:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448662.157597:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157605:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc38200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.157608:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157616:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157627:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157645:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a83e09c5/0xd0e9b344b90ac17a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.157663:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.157666:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.157668:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.158704:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.158713:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.158726:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.158730:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.158816:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.158831:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.158839:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.158848:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.158877:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.158907:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.158917:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.158928:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.158933:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.158943:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159030:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159045:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a29d2ad/0xd0e9b344b90ac181 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159071:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.159074:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.159077:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.159322:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.159333:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.159342:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.159346:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.159351:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.159359:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.159367:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.159374:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.159400:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.159467:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.159473:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159482:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.159486:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159494:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159508:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159516:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f5dae8d/0xd0e9b344b90ac188 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.159533:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.159536:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.159537:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.163035:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.163052:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163069:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.163073:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.163080:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163095:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163115:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163122:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163153:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.163298:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.163307:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.163328:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031a00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.163333:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.163343:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.163364:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.163371:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb637d00/0xd0e9b344b90ac18f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.163395:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.163397:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.163399:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.163698:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.163704:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163713:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.163717:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.163721:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.163731:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166093:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166103:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166152:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788448662.166167:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448662.166172:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166180:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.166201:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166211:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166228:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166235:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004652a30b/0xd0e9b344b90ac196 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.166255:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.166257:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.166258:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.167456:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.167465:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.167481:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.167491:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.167498:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.167513:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.167522:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.167530:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.167559:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.167591:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.167599:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.167609:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030c00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.167613:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.167744:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.167767:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.168030:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c8227a53/0xd0e9b344b90ac19d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.168052:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.168054:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.168056:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.169073:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.169081:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.169093:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.169097:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.169103:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.169115:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.169125:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.169140:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.169167:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.169249:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.169257:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.169279:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.169284:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.169294:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.169323:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.169344:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa69860/0xd0e9b344b90ac1a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.169369:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.169372:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.169375:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788448662.171082:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:3.0:1788448662.172663:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.172678:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.172696:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.172701:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.172708:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.172722:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.172969:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.172979:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173008:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.173156:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.173165:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.173176:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.173181:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.173207:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.173226:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.173233:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d60cf87f/0xd0e9b344b90ac1ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.173256:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.173279:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.173281:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.173660:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.173666:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173682:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.173686:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.173690:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173701:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173710:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173717:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.173969:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.174672:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.174681:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.174691:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.174696:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.174706:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.174723:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.174730:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058ba8777/0xd0e9b344b90ac1b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.174750:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.174752:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.174753:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.175176:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.175199:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.175211:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.175215:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.175220:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.175231:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.175252:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.175260:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.175291:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.175311:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.175318:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.175327:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.175331:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.175348:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.175362:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.175370:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001a246d86/0xd0e9b344b90ac1b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.175386:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.175388:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.175389:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.176147:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.176154:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176166:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.176170:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.176175:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176209:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176218:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176227:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176257:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.176802:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.176810:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.176828:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6ae00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.176833:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.176843:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788448662.176869:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.176869:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176881:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176893:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.176900:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.176902:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000038d675d/0xd0e9b344b90ac1c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176905:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.176925:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.176929:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.176932:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.176933:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176943:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176950:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.176969:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.177561:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1788448662.177569:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.177569:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177579:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177594:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.177595:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6be00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.177598:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177607:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.177611:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177613:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177628:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177635:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177638:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177646:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177665:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006e4dd2c8/0xd0e9b344b90ac1c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.177675:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.177682:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.177687:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177702:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6a400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.177706:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177714:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177725:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177732:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078f54808/0xd0e9b344b90ac1ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.177750:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.177752:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.177755:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.177779:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788448662.178073:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1788448662.178079:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.178087:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=522s v=(0 0) 00010000:00010000:3.0:1788448662.178090:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448662.178094:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.178103:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.178110:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.178123:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.178143:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788448662.179181:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788448662.179205:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.179216:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6aa00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448662.179221:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.179230:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.179258:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.179276:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000805ee7b0/0xd0e9b344b90ac1d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.179298:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.179300:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.179303:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448662.182725:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.182738:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.182756:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.182760:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.182768:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.182781:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.182791:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.182799:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.182867:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448662.183524:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.183531:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.183543:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.183546:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.183551:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.184258:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.184281:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.184289:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186631:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448662.186648:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186666:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629200 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.186671:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186683:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186705:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186713:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007c2fd2ad/0xd0e9b344b90ac1dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186736:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448662.186740:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186766:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178a00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448662.186769:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186777:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186788:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.186796:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.186798:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.186800:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448662.187453:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1788448662.187463:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aea83c05/0xd0e9b344b90ac1e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448662.188235:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448662.188546:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.188554:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.188575:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.188580:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.188586:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.188599:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.188608:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.188615:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.188658:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448662.189219:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.189226:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189236:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.189240:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.189244:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189254:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189285:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189293:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189311:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788448662.189338:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448662.189345:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189353:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.189358:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189367:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189394:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189402:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c0b9d62/0xd0e9b344b90ac1ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189417:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448662.189421:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189427:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179a00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.189437:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189445:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189455:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189463:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000014e83f94/0xd0e9b344b90ac1f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.189475:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.189477:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.189479:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448662.189687:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.189693:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189702:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.189705:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.189709:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189719:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189727:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189735:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.189758:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788448662.190437:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.190444:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190455:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.190458:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.190463:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190473:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190481:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190489:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190509:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788448662.190514:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788448662.190520:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190528:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179800 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.190532:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190541:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190553:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190568:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afdf0762/0xd0e9b344b90ac1f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190584:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448662.190588:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190594:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.190597:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190605:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190615:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190622:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9d5c1ef/0xd0e9b344b90ac1ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.190634:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.190636:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.190637:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788448662.190884:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1788448662.190891:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190899:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=522s v=(0 0) 00010000:00010000:2.0:1788448662.190906:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448662.190910:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190919:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190927:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190934:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448662.190953:0:15107:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1788448662.191406:0:15107:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:2.0:1788448662.191499:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14445:x1875323926976256:12345-0@lo:5:osp-pre-1-0.0 Request processed in 70091us (70874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448662.191510:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788448662.191566:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875323926976256:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788448662.191580:0:14445:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:2.0:1788448662.191625:0:14445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875323926976384:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788448662.191656:0:14445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448662.191690:0:14445:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807434000 going to sleep for 11 seconds 00000100:00100000:2.0:1788448662.191705:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976384 00000100:00100000:2.0:1788448662.191711:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976384 00000100:00100000:2.0:1788448662.191745:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788448662.191753:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14445:x1875323926976384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1788448662.191796:0:15107:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:0.0:1788448662.191828:0:14409:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448662.191834:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.191848:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842178e00 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448662.191852:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.191860:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.191873:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.191880:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082d704b3/0xd0e9b344b90ac206 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448662.191895:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.191897:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448662.191899:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.192377:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448662.192391:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448662.198562:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14445:x1875323926976384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 6800us (6896us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1788448662.198575:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788448662.198665:0:14445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704686680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14445:1875323926976384:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1788448662.198680:0:14445:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1788448662.437371:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788448663.086479:0:16184:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg437-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788448663.457525:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448664.485384:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448665.334650:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.334829:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902862976 00000100:00100000:1.0:1788448665.334839:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902862976 00000100:00100000:1.0:1788448665.334890:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1788448665.334898:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2351:x1875323902862976:12345-192.168.204.37@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788448665.334931:0:14414:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 2b87d97b-2a51-4dd7-b64d-d66fcebdef11@192.168.204.37@tcp t0 exp 0000000000000000 cur 525 last 0 00000020:00000080:1.0:1788448665.334966:0:14414:0:(genops.c:1385:class_connect()) connect: client 2b87d97b-2a51-4dd7-b64d-d66fcebdef11, cookie 0xd0e9b344b90ac20d 00000100:00080000:1.0:1788448665.335124:0:14414:0:(import.c:65:import_set_state_nolock()) ffff99a706cda000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448665.335488:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+5:2351:x1875323902862976:12345-192.168.204.37@tcp:250:mount.lustre.0 Request processed in 586us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.335498:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 76 00000100:00100000:1.0:1788448665.341264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448665.344509:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863104 00000100:00100000:2.0:1788448665.344531:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863104 00000100:00100000:2.0:1788448665.344708:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:2.0:1788448665.344721:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+5:13753:x1875323902863104:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448665.344744:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448665.344768:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178e00/0xd0e9b344b90ac214 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510da7 expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.344809:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178e00/0xd0e9b344b90ac214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510da7 expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.344822:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178e00/0xd0e9b344b90ac214 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510da7 expref: 6 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.344832:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178e00, rc 0) 00000100:00100000:2.0:1788448665.344921:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+6:13753:x1875323902863104:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 202us (3673us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.344929:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 77 00000100:00100000:2.0:1788448665.354852:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.355705:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863232 00000100:00100000:0.0:1788448665.355769:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863232 00000100:00100000:0.0:1788448665.355820:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:0.0:1788448665.355830:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+6:13753:x1875323902863232:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448665.356826:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+6:13753:x1875323902863232:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 991us (1980us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788448665.356851:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 78 00000100:00100000:0.0:1788448665.360859:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448665.360964:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863360 00000100:00100000:2.0:1788448665.360980:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863360 00000100:00100000:2.0:1788448665.361055:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:2.0:1788448665.361066:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+6:13753:x1875323902863360:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448665.361098:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448665.361121:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178000/0xd0e9b344b90ac21b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510dae expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.361152:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178000/0xd0e9b344b90ac21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510dae expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.361163:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178000/0xd0e9b344b90ac21b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510dae expref: 7 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.361173:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178000, rc 0) 00000100:00100000:2.0:1788448665.361299:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+7:13753:x1875323902863360:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 234us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.361307:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 79 00000100:00100000:1.0:1788448665.372022:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.373554:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863488 00000100:00100000:0.0:1788448665.373574:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863488 00000100:00100000:0.0:1788448665.373665:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:0.0:1788448665.373678:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+7:13753:x1875323902863488:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788448665.374586:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13753:x1875323902863488:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 904us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.374598:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 80 00000100:00100000:1.0:1788448665.380666:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448665.384501:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863616 00000100:00100000:2.0:1788448665.384524:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863616 00000100:00100000:2.0:1788448665.384619:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:2.0:1788448665.384632:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13753:x1875323902863616:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788448665.385965:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13753:x1875323902863616:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 1325us (5305us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448665.385979:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 81 00000100:00100000:2.0:1788448665.397668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.400129:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863744 00000100:00100000:1.0:1788448665.400151:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863744 00000100:00100000:1.0:1788448665.400540:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:1.0:1788448665.400554:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13772:x1875323902863744:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448665.401024:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13772:x1875323902863744:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 470us (3371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.401103:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 82 00000100:00100000:1.0:1788448665.431497:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448665.431640:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902863872 00000100:00100000:3.0:1788448665.431654:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902863872 00000100:00100000:3.0:1788448665.431728:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:3.0:1788448665.431741:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13772:x1875323902863872:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788448665.434980:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803398050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13772:x1875323902863872:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 3220us (3478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448665.435013:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 83 00000100:00100000:2.0:1788448665.449535:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.449706:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864000 00000100:00100000:1.0:1788448665.449720:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864000 00000100:00100000:1.0:1788448665.449808:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:1.0:1788448665.449820:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a803399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+8:13753:x1875323902864000:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448665.449846:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448665.449870:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ed000/0xd0e9b344b90ac222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510dd8 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448665.449914:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ed000/0xd0e9b344b90ac222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510dd8 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448665.449928:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ed000/0xd0e9b344b90ac222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510dd8 expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448665.449939:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed000, rc 0) 00000100:00100000:1.0:1788448665.450024:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a803399050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+9:13753:x1875323902864000:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 205us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.450032:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 84 00000100:00100000:2.0:1788448665.461516:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448665.462165:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864128 00000100:00100000:3.0:1788448665.462180:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864128 00000100:00100000:3.0:1788448665.462323:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:3.0:1788448665.462336:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80339a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+9:13753:x1875323902864128:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788448665.462370:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788448665.462403:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788448665.462408:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788448665.462412:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788448665.462414:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788448665.471669:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80339a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+9:13753:x1875323902864128:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 9314us (10148us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.471689:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 85 00000100:00100000:2.0:1788448665.482540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.486687:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864256 00000100:00100000:0.0:1788448665.486708:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864256 00000100:00100000:0.0:1788448665.486799:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:0.0:1788448665.486812:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+9:13753:x1875323902864256:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788448665.486835:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448665.486860:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ddf expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448665.486898:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448665.486912:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448665.486924:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:0.0:1788448665.488664:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13753:x1875323902864256:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 1836us (6121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.488705:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 86 00000100:00100000:2.0:1788448665.496612:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.497128:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864384 00000100:00100000:1.0:1788448665.497143:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864384 00000100:00100000:1.0:1788448665.497290:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:1.0:1788448665.498092:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13753:x1875323902864384:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788448665.498753:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13753:x1875323902864384:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 1435us (2152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.498766:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 87 00000100:00100000:3.0:1788448665.500793:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.500902:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864512 00000100:00100000:0.0:1788448665.500915:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864512 00000100:00100000:0.0:1788448665.500985:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:0.0:1788448665.500997:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13753:x1875323902864512:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788448665.501769:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13753:x1875323902864512:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 767us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.501782:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 88 00000100:00100000:2.0:1788448665.505093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.505561:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864640 00000100:00100000:1.0:1788448665.505574:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864640 00000100:00100000:1.0:1788448665.505650:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 89 00000100:00100000:1.0:1788448665.505663:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13776:x1875323902864640:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448665.506287:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13776:x1875323902864640:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 621us (1203us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.506311:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 89 00010000:00010000:1.0:1788448665.508676:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448665.513958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448665.519109:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864768 00000100:00100000:2.0:1788448665.519134:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864768 00000100:00100000:2.0:1788448665.519735:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:2.0:1788448665.519752:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13776:x1875323902864768:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788448665.520559:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13776:x1875323902864768:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 806us (6609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.520571:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 90 00000100:00100000:2.0:1788448665.539711:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.543632:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902864896 00000100:00100000:1.0:1788448665.543653:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902864896 00000100:00100000:1.0:1788448665.543800:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1788448665.543811:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2351:x1875323902864896:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448665.543854:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 6a047eef-0fdc-4732-b562-29a19de3e157@192.168.204.37@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:1.0:1788448665.543925:0:14420:0:(genops.c:1385:class_connect()) connect: client 6a047eef-0fdc-4732-b562-29a19de3e157, cookie 0xd0e9b344b90ac230 00000004:00100000:1.0:1788448665.543968:0:14420:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1788448665.543975:0:14420:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:0.0:1788448665.595627:0:14420:0:(import.c:65:import_set_state_nolock()) ffff99a7054a4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788448665.595726:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2351:x1875323902864896:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 51914us (56031us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.595739:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1788448665.601918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.602043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.602249:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865024 00000100:00100000:0.0:1788448665.602264:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865024 00000100:00100000:0.0:1788448665.602364:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865152 00000100:00100000:0.0:1788448665.602368:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865152 00000100:00100000:0.0:1788448665.602388:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1788448665.602406:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:0:x1875323902865024:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448665.602468:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788448665.602588:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:0:x1875323902865024:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 189us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.602597:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1788448665.602619:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1788448665.602626:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865152:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448665.602637:0:14421:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788448665.602677:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865152:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 52us (634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448665.602685:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00080000:1.0:1788448665.602840:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448665.605514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448665.605578:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865280 00000100:00100000:3.0:1788448665.605593:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865280 00000100:00100000:3.0:1788448665.605668:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1788448665.605680:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865280:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:3.0:1788448665.605788:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865280:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 110us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448665.605797:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:3.0:1788448665.608373:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448665.608495:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865408 00000100:00100000:0.0:1788448665.608507:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865408 00000100:00100000:0.0:1788448665.608566:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1788448665.608577:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2351:x1875323902865408:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:0.0:1788448665.608620:0:15106:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 6a047eef-0fdc-4732-b562-29a19de3e157@192.168.204.37@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:0.0:1788448665.608706:0:15106:0:(genops.c:1385:class_connect()) connect: client 6a047eef-0fdc-4732-b562-29a19de3e157, cookie 0xd0e9b344b90ac237 00002000:00100000:0.0:1788448665.608721:0:15106:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 6a047eef-0fdc-4732-b562-29a19de3e157/ffff99a8092e2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788448665.608753:0:15106:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788448665.609508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448665.609607:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865536 00000100:00100000:3.0:1788448665.609616:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865536 00000100:00100000:3.0:1788448665.609660:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1788448665.609668:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902865536:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788448665.609696:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 6a047eef-0fdc-4732-b562-29a19de3e157@192.168.204.37@tcp t0 exp 0000000000000000 cur 526 last 0 00000020:00000080:3.0:1788448665.609728:0:15108:0:(genops.c:1385:class_connect()) connect: client 6a047eef-0fdc-4732-b562-29a19de3e157, cookie 0xd0e9b344b90ac23e 00002000:00100000:3.0:1788448665.609737:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 6a047eef-0fdc-4732-b562-29a19de3e157/ffff99a705588000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788448665.609757:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788448665.609958:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788448665.609996:0:15108:0:(import.c:65:import_set_state_nolock()) ffff99a70558e000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788448665.610082:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+6:2351:x1875323902865536:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 412us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448665.610091:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1788448665.612695:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448665.612914:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865664 00000100:00100000:1.0:1788448665.612927:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865664 00000100:00100000:1.0:1788448665.612994:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:1.0:1788448665.613007:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865664:12345-192.168.204.37@tcp:33:mount.lustre.0 00002000:00080000:2.0:1788448665.617242:0:15106:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448665.617318:0:15106:0:(import.c:65:import_set_state_nolock()) ffff99a706c77800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448665.617430:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2351:x1875323902865408:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 8851us (9070us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.617443:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000004:00080000:3.0:1788448665.617659:0:14423:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 4551us 00000004:00200000:1.0:1788448665.632450:0:14423:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1788448665.632612:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:13753:x1875323902865664:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 19600us (19924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448665.632625:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:3.0:1788448665.696511:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788448665.701619:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926976512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448665.701733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448665.701890:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976512 00000100:00100000:2.0:1788448665.701903:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976512 00000100:00100000:2.0:1788448665.701981:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788448665.701993:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926976512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788448665.702030:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448665.702102:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926976512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.702109:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1788448665.705249:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788448665.707259:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83d2e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926976512:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788448665.802815:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448665.803013:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865792 00000100:00100000:2.0:1788448665.803026:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865792 00000100:00100000:2.0:1788448665.803115:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:2.0:1788448665.803129:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+6:13797:x1875323902865792:12345-192.168.204.37@tcp:101:mkdir.0 00010000:00010000:2.0:1788448665.803157:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448665.803254:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178a00/0xd0e9b344b90ac245 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e09 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803352:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803386:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803405:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448665.803455:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448665.803459:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448665.803508:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803542:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178a00/0xd0e9b344b90ac245 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e09 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803683:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e09 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448665.803696:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:2.0:1788448665.803699:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448665.803704:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178400, rc 0) 00000100:00100000:2.0:1788448665.803789:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:13797:x1875323902865792:12345-192.168.204.37@tcp:101:mkdir.0 Request processed in 663us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448665.803798:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00010000:00010000:3.0:1788448666.529169:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788448667.232740:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926976640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448667.232845:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238520:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926977024:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.238636:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238691:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448667.238698:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926977152:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.238722:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926976896:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.238787:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238806:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788448667.238812:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926976768:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.238842:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238878:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926977280:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.238901:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448667.238939:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977024 00000100:00100000:1.0:1788448667.238948:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977024 00000100:00100000:1.0:1788448667.239000:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977152 00000100:00100000:1.0:1788448667.239003:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977152 00000100:00100000:1.0:1788448667.239030:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977280 00000100:00100000:1.0:1788448667.239033:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977280 00000100:00100000:1.0:1788448667.239074:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448667.239084:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926977024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.239709:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926977024:12345-0@lo:400:kworker.0 Request processed in 623us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448667.239718:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788448667.239743:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448667.239752:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926977152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.239784:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926977152:12345-0@lo:400:kworker.0 Request processed in 34us (1061us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448667.239790:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788448667.239803:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448667.239810:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926977280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.239844:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926977280:12345-0@lo:400:kworker.0 Request processed in 35us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448667.239850:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448667.239878:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976768 00000100:00100000:1.0:1788448667.239883:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976768 00000100:00100000:1.0:1788448667.239919:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788448667.239927:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:3310:x1875323926976768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.239958:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:3310:x1875323926976768:12345-0@lo:400:kworker.0 Request processed in 33us (1115us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448667.239964:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00080000:1.0:1788448667.240002:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448667.240038:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926976768:0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.240056:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926977280:0@lo:400:kworker.0 00000100:00100000:3.0:1788448667.240350:0:15539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976896 00000100:00100000:3.0:1788448667.240367:0:15539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976896 00000100:00100000:3.0:1788448667.240413:0:15539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788448667.240421:0:15539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926976896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448667.240613:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926977152:0@lo:400:kworker.0 00000100:00100000:3.0:1788448667.250962:0:15539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926976896:12345-0@lo:400:kworker.0 Request processed in 10525us (12156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448667.250991:0:15539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788448667.251054:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448667.251130:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926976896:0@lo:400:kworker.0 00000100:00100000:3.0:1788448667.251212:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926976640 00000100:00100000:3.0:1788448667.251221:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926976640 00000100:00100000:3.0:1788448667.251289:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448667.251298:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875323926976640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448667.251334:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448667.251394:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1875323926976640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (18550us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448667.251401:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1788448667.251417:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448667.257441:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926976640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448667.266617:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926977024:0@lo:400:kworker.0 00000001:00080000:1.0:1788448667.422706:0:7637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1788448667.422855:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6a047eef-0fdc-4732-b562-29a19de3e157 00010000:00010000:2.0:1788448667.556275:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788448667.825032:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6a047eef-0fdc-4732-b562-29a19de3e157 00000100:00100000:1.0:1788448667.831547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448667.831650:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902865920 00000100:00100000:3.0:1788448667.831661:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902865920 00000100:00100000:3.0:1788448667.831751:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00080000:0.0:1788448667.831758:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448667.831763:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:13849:x1875323902865920:12345-192.168.204.37@tcp:41:lfs.0 00000004:00000024:3.0:1788448667.831825:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1788448667.831916:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:13849:x1875323902865920:12345-192.168.204.37@tcp:41:lfs.0 Request processed in 156us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448667.831924:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1788448667.835044:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448667.835118:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866048 00000100:00100000:3.0:1788448667.835128:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866048 00000100:00100000:3.0:1788448667.835229:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:3.0:1788448667.835240:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a047eef-0fdc-4732-b562-29a19de3e157+5:13849:x1875323902866048:12345-192.168.204.37@tcp:13:lfs.0 00002000:00000024:3.0:1788448667.835275:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1788448667.835365:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448667.837608:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d2e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a047eef-0fdc-4732-b562-29a19de3e157+5:13849:x1875323902866048:12345-192.168.204.37@tcp:13:lfs.0 Request processed in 2357us (2561us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448667.837621:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1788448667.849305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448667.849454:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866176 00000100:00100000:1.0:1788448667.849469:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866176 00000100:00100000:1.0:1788448667.849662:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:1.0:1788448667.849674:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a047eef-0fdc-4732-b562-29a19de3e157+5:13849:x1875323902866176:12345-192.168.204.37@tcp:13:lfs.0 00002000:00000024:1.0:1788448667.849723:0:15109:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448667.849977:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:6a047eef-0fdc-4732-b562-29a19de3e157+5:13849:x1875323902866176:12345-192.168.204.37@tcp:13:lfs.0 Request processed in 304us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448667.849985:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00080000:0.0:1788448667.850222:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448668.048404:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448668.048886:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866304 00000100:00100000:2.0:1788448668.048896:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866304 00000100:00100000:2.0:1788448668.048960:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:2.0:1788448668.048987:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+10:13879:x1875323902866304:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448668.049004:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448668.049022:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178c00/0xd0e9b344b90ac253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e10 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.049052:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178c00/0xd0e9b344b90ac253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e10 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.049063:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178c00/0xd0e9b344b90ac253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e10 expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.049072:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178c00, rc 0) 00000100:00100000:2.0:1788448668.049163:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866304:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 178us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.049170:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 92 00000100:00100000:2.0:1788448668.051656:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.051773:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866432 00000100:00100000:1.0:1788448668.051783:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866432 00000100:00100000:1.0:1788448668.051968:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:1.0:1788448668.051979:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866432:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788448668.052341:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866432:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 362us (692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.052350:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 93 00000100:00100000:0.0:1788448668.061414:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.061746:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866560 00000100:00100000:1.0:1788448668.061757:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866560 00000100:00100000:1.0:1788448668.061876:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:1.0:1788448668.061887:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866560:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788448668.062240:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866560:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 355us (835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.062250:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 94 00000100:00100000:0.0:1788448668.084254:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.087420:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866688 00000100:00100000:1.0:1788448668.087436:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866688 00000100:00100000:1.0:1788448668.087519:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:1.0:1788448668.087530:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13885:x1875323902866688:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448668.087889:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13885:x1875323902866688:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 359us (3646us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.087898:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 95 00000100:00100000:3.0:1788448668.126910:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.127034:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866816 00000100:00100000:1.0:1788448668.127052:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866816 00000100:00100000:1.0:1788448668.127164:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:1.0:1788448668.127177:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13885:x1875323902866816:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788448668.127530:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13885:x1875323902866816:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 354us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.127539:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 96 00000100:00100000:0.0:1788448668.141290:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448668.141416:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902866944 00000100:00100000:2.0:1788448668.141431:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902866944 00000100:00100000:2.0:1788448668.141509:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:2.0:1788448668.141523:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13879:x1875323902866944:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788448668.141548:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448668.141573:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842178800/0xd0e9b344b90ac25a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e3a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.141625:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842178800/0xd0e9b344b90ac25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e3a expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.141641:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842178800/0xd0e9b344b90ac25a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e3a expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448668.141672:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842178800, rc 0) 00000100:00100000:2.0:1788448668.141761:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13879:x1875323902866944:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 241us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.141769:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 97 00000100:00100000:2.0:1788448668.154789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.155556:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867072 00000100:00100000:1.0:1788448668.155575:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867072 00000100:00100000:1.0:1788448668.155852:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:1.0:1788448668.155866:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13879:x1875323902867072:12345-192.168.204.37@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788448668.155905:0:14415:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788448668.155941:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788448668.155946:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788448668.155950:0:14415:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788448668.155960:0:14415:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:1.0:1788448668.167460:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13879:x1875323902867072:12345-192.168.204.37@tcp:256:mount.lustre.0 Request processed in 11576us (12668us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.167480:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 98 00000100:00100000:0.0:1788448668.172561:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.172732:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867200 00000100:00100000:1.0:1788448668.172747:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867200 00000100:00100000:1.0:1788448668.172826:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:1.0:1788448668.172840:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13879:x1875323902867200:12345-192.168.204.37@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788448668.172867:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448668.172892:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e41 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.172930:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.172944:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.172965:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec400, rc 0) 00000100:00100000:1.0:1788448668.173036:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13879:x1875323902867200:12345-192.168.204.37@tcp:101:mount.lustre.0 Request processed in 199us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.173045:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 99 00000100:00100000:2.0:1788448668.175715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.176938:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867328 00000100:00100000:1.0:1788448668.176966:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867328 00000100:00100000:1.0:1788448668.177056:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:1.0:1788448668.177070:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13879:x1875323902867328:12345-192.168.204.37@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788448668.177819:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13879:x1875323902867328:12345-192.168.204.37@tcp:501:mount.lustre.0 Request processed in 747us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.177841:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 100 00000100:00100000:3.0:1788448668.185677:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448668.185779:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867456 00000100:00100000:2.0:1788448668.185794:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867456 00000100:00100000:2.0:1788448668.185864:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:2.0:1788448668.185876:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8099d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13879:x1875323902867456:12345-192.168.204.37@tcp:503:mount.lustre.0 00000100:00100000:2.0:1788448668.186398:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8099d5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13879:x1875323902867456:12345-192.168.204.37@tcp:503:mount.lustre.0 Request processed in 521us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.186407:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 101 00000100:00100000:3.0:1788448668.188856:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448668.191634:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867584 00000100:00100000:0.0:1788448668.191654:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867584 00000100:00100000:0.0:1788448668.191749:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:0.0:1788448668.191845:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13893:x1875323902867584:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448668.192469:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13893:x1875323902867584:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 624us (3624us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448668.192480:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 102 00000100:00100000:3.0:1788448668.197989:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.198086:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867712 00000100:00100000:1.0:1788448668.198101:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867712 00000100:00100000:0.0:1788448668.198329:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:0.0:1788448668.198348:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13893:x1875323902867712:12345-192.168.204.37@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788448668.198713:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13893:x1875323902867712:12345-192.168.204.37@tcp:502:llog_process_th.0 Request processed in 370us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448668.198723:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 103 00000100:00100000:3.0:1788448668.202839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448668.202896:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448668.202933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448668.202972:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.203297:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868352 00000100:00100000:1.0:1788448668.203310:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868352 00000100:00100000:1.0:1788448668.203375:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868480 00000100:00100000:1.0:1788448668.203378:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868480 00000100:00100000:1.0:1788448668.203410:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:1.0:1788448668.203423:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902868352:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448668.203434:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:2.0:1788448668.203449:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902868480:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448668.203525:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902868352:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 104us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.203533:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:0.0:1788448668.203589:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867840 00000100:00100000:0.0:1788448668.203595:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867840 00000100:00100000:0.0:1788448668.203630:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868224 00000100:00100000:0.0:1788448668.203634:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868224 00000100:00100000:0.0:1788448668.203660:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1788448668.203668:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+7:2355:x1875323902868224:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448668.203749:0:14421:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788448668.203761:0:14421:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1788448668.203909:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1788448668.203918:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2351:x1875323902867840:12345-192.168.204.37@tcp:38:mount.lustre.0 00010000:00080000:1.0:1788448668.203961:0:14421:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 49a983be-943b-4a5c-88b2-af962c3d45bc@192.168.204.37@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:1.0:1788448668.204015:0:14421:0:(genops.c:1385:class_connect()) connect: client 49a983be-943b-4a5c-88b2-af962c3d45bc, cookie 0xd0e9b344b90ac268 00000004:00100000:1.0:1788448668.204061:0:14421:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788448668.208314:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902868480:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 4849us (5320us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.208336:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:0.0:1788448668.210011:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+7:2355:x1875323902868224:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 6327us (7060us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448668.210030:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00080000:1.0:1788448668.210953:0:14421:0:(import.c:65:import_set_state_nolock()) ffff99a706cde000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788448668.211051:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2351:x1875323902867840:12345-192.168.204.37@tcp:38:mount.lustre.0 Request processed in 7128us (8225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.211064:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1788448668.213919:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448668.213996:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868096 00000100:00100000:0.0:1788448668.214011:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868096 00000100:00100000:0.0:1788448668.214119:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1788448668.214156:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:13879:x1875323902868096:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448668.214230:0:14422:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1788448668.214524:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:13879:x1875323902868096:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 392us (619us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448668.214566:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00080000:3.0:1788448668.216392:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448668.216473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448668.216533:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902867968 00000100:00100000:0.0:1788448668.216930:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902867968 00000100:00100000:3.0:1788448668.216997:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448668.219734:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868608 00000100:00100000:0.0:1788448668.219757:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868608 00000100:00100000:0.0:1788448668.219951:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:0.0:1788448668.219966:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+7:0:x1875323902867968:12345-192.168.204.37@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788448668.220015:0:16303:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1788448668.220482:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:1.0:1788448668.220956:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+7:13879:x1875323902868608:12345-192.168.204.37@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788448668.221073:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+7:13879:x1875323902868608:12345-192.168.204.37@tcp:40:mount.lustre.0 Request processed in 138us (4076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.221081:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:0.0:1788448668.221373:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+6:0:x1875323902867968:12345-192.168.204.37@tcp:41:mount.lustre.0 Request processed in 1408us (4906us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448668.221382:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1788448668.226126:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.226281:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.226323:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448668.227574:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868736 00000100:00100000:2.0:1788448668.227592:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868736 00000100:00100000:2.0:1788448668.227663:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868864 00000100:00100000:2.0:1788448668.227666:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868864 00000100:00100000:2.0:1788448668.227697:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448668.227708:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902868736:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448668.227775:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 49a983be-943b-4a5c-88b2-af962c3d45bc@192.168.204.37@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1788448668.227822:0:15108:0:(genops.c:1385:class_connect()) connect: client 49a983be-943b-4a5c-88b2-af962c3d45bc, cookie 0xd0e9b344b90ac26f 00002000:00100000:2.0:1788448668.227837:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49a983be-943b-4a5c-88b2-af962c3d45bc/ffff99a8064a0000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448668.227851:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448668.228183:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788448668.228271:0:15108:0:(import.c:65:import_set_state_nolock()) ffff99a8064a3800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448668.228366:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2351:x1875323902868736:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 658us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.228376:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448668.228402:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448668.228408:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2351:x1875323902868864:12345-192.168.204.37@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788448668.228427:0:15108:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 49a983be-943b-4a5c-88b2-af962c3d45bc@192.168.204.37@tcp t0 exp 0000000000000000 cur 528 last 0 00000020:00000080:2.0:1788448668.228446:0:15108:0:(genops.c:1385:class_connect()) connect: client 49a983be-943b-4a5c-88b2-af962c3d45bc, cookie 0xd0e9b344b90ac276 00002000:00100000:2.0:1788448668.228453:0:15108:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49a983be-943b-4a5c-88b2-af962c3d45bc/ffff99a809ae7800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113967 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788448668.228460:0:15108:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788448668.228613:0:15108:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788448668.228631:0:15108:0:(import.c:65:import_set_state_nolock()) ffff99a8295c9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788448668.228656:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2351:x1875323902868864:12345-192.168.204.37@tcp:8:mount.lustre.0 Request processed in 246us (2332us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448668.228663:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1788448668.229034:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902868992 00000100:00100000:3.0:1788448668.229044:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902868992 00000100:00100000:3.0:1788448668.230213:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448668.230243:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:13879:x1875323902868992:12345-192.168.204.37@tcp:33:mount.lustre.0 00000004:00200000:3.0:1788448668.230355:0:14424:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788448668.230440:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:13879:x1875323902868992:12345-192.168.204.37@tcp:33:mount.lustre.0 Request processed in 212us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448668.236993:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448668.435139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448668.435272:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869120 00000100:00100000:1.0:1788448668.435287:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869120 00000100:00100000:1.0:1788448668.435385:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448668.435409:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+6:13914:x1875323902869120:12345-192.168.204.37@tcp:101:mkdir.0 00010000:00010000:1.0:1788448668.435443:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448668.435478:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac27d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e6b expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435574:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435593:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435612:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448668.435665:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788448668.435670:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448668.435696:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435730:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac27d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 8 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435773:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 7 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448668.435784:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:1.0:1788448668.435787:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448668.435791:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ede00, rc 0) 00000100:00100000:1.0:1788448668.435888:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+7:13914:x1875323902869120:12345-192.168.204.37@tcp:101:mkdir.0 Request processed in 482us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448668.435897:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00010000:00010000:1.0:1788448668.577735:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448668.960999:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448669.602630:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788448670.630275:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788448670.820817:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788448670.820852:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926977408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448670.820972:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448670.821475:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977408 00000100:00100000:1.0:1788448670.821488:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977408 00000100:00100000:1.0:1788448670.821585:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448670.821599:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926977408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448670.821646:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448670.821717:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926977408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448670.821724:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788448670.821790:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926977408:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788448670.821993:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788448670.883176:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6a047eef-0fdc-4732-b562-29a19de3e157 00000001:00100000:1.0:1788448670.883249:0:5859:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49a983be-943b-4a5c-88b2-af962c3d45bc 00010000:00010000:1.0:1788448671.655717:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788448671.681708:0:16390:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1788448672.354139:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926977664:0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.354139:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926977536:0@lo:400:kworker.0 00000100:00100000:2.0:1788448672.354317:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926977920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448672.361129:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926977792:0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.363503:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448672.363569:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926978176:0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.363608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448672.363649:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977664 00000100:00100000:3.0:1788448672.363655:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977664 00000100:00100000:3.0:1788448672.363732:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448672.363748:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926977664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.363797:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1875323926977664:12345-0@lo:400:kworker.0 Request processed in 58us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448672.363803:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448672.363825:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978176 00000100:00100000:3.0:1788448672.363828:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978176 00000100:00100000:3.0:1788448672.363851:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788448672.363857:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926978176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.363881:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1875323926978176:12345-0@lo:400:kworker.0 Request processed in 25us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448672.363887:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1788448672.363899:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788448672.363903:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448672.363932:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3312:1875323926977664:0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.363942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3312:1875323926978176:0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.367971:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448672.368055:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926978048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.368117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448672.368160:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978048 00000100:00100000:1.0:1788448672.368170:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978048 00000100:00100000:3.0:1788448672.368314:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977536 00000100:00100000:3.0:1788448672.368320:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977536 00000100:00100000:3.0:1788448672.368360:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788448672.368370:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926977536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788448672.368438:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926977536:12345-0@lo:400:kworker.0 Request processed in 69us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448672.368445:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:3.0:1788448672.368935:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788448672.370216:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448672.370232:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926978048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.370305:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1875323926978048:12345-0@lo:400:kworker.0 Request processed in 78us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448672.370311:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788448672.370361:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d38000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3311:1875323926978048:0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.370389:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926977536:0@lo:400:kworker.0 00000100:00100000:2.0:1788448672.370528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448672.370633:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977920 00000100:00100000:1.0:1788448672.370640:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977920 00000100:00100000:1.0:1788448672.370677:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788448672.370871:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926977920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.370918:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1875323926977920:12345-0@lo:400:kworker.0 Request processed in 234us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448672.370925:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788448672.370989:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3310:1875323926977920:0@lo:400:kworker.0 00000100:00100000:0.0:1788448672.371083:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448672.371117:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926978304:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788448672.371149:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448672.375433:0:15539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926977792 00000100:00100000:1.0:1788448672.375449:0:15539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926977792 00000100:00100000:1.0:1788448672.375523:0:15539:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448672.375535:0:15539:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926977792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448672.375632:0:15539:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926977792:12345-0@lo:400:kworker.0 Request processed in 100us (4549us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448672.375639:0:15539:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788448672.375661:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788448672.379885:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1788448672.379918:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926977792:0@lo:400:kworker.0 00000100:00100000:2.0:1788448672.384794:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978304 00000100:00100000:2.0:1788448672.384808:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978304 00000100:00100000:2.0:1788448672.384866:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788448672.384877:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926978304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448672.384913:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448672.385004:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926978304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (13853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448672.385011:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788448672.385313:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926978304:0@lo:13:osp-pre-1-0.0 00000001:00100000:3.0:1788448672.411159:0:7637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49a983be-943b-4a5c-88b2-af962c3d45bc 00010000:00010000:2.0:1788448672.676583:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788448672.915069:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49a983be-943b-4a5c-88b2-af962c3d45bc 00010000:00010000:3.0:1788448673.696431:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448673.716137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716234:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716262:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716286:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716305:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716352:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448673.716388:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869760 00000100:00100000:3.0:1788448673.716400:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869760 00000100:00100000:3.0:1788448673.716474:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869376 00000100:00100000:3.0:1788448673.716478:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869376 00000100:00100000:3.0:1788448673.716509:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448673.716520:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2355:x1875323902869760:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448673.716621:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2355:x1875323902869760:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 102us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448673.716630:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448673.716648:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1788448673.716655:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902869376:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448673.716682:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902869376:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 27us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448673.716689:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1788448673.716710:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869504 00000100:00100000:3.0:1788448673.716714:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869504 00000100:00100000:0.0:1788448673.716883:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869248 00000100:00100000:0.0:1788448673.716888:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869248 00000100:00100000:0.0:1788448673.716924:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:0.0:1788448673.716932:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2355:x1875323902869248:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448673.716963:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2355:x1875323902869248:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 32us (842us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448673.716970:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 105 00000100:00100000:0.0:1788448673.717093:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870016 00000100:00100000:0.0:1788448673.717097:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870016 00000100:00100000:2.0:1788448673.717164:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869632 00000100:00100000:2.0:1788448673.717168:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869632 00000100:00100000:3.0:1788448673.717250:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902869888 00000100:00100000:3.0:1788448673.717253:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902869888 00000100:00100000:0.0:1788448673.724123:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448673.724154:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902869504:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448673.724281:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902869504:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 142us (8045us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448673.724290:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448673.724329:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448673.724339:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902870016:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448673.724369:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902870016:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 33us (8082us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448673.724375:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00080000:0.0:1788448673.724482:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788448673.724490:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788448673.724495:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448673.732016:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:2.0:1788448673.732054:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902869632:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448673.732210:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902869632:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 178us (15882us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448673.732220:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:3.0:1788448673.740164:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:3.0:1788448673.740233:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902869888:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448673.741471:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902869888:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 1238us (25105us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448673.741486:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00010000:00010000:1.0:1788448674.721330:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788448675.418760:0:16539:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc31790300 20000000:00000080:1.0:1788448675.418777:0:16539:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff99a705db0000 uarg=0000000000000000 20000000:01000000:1.0:1788448675.418815:0:16539:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788448675.418821:0:16539:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1788448675.418826:0:16539:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1788448675.426317:0:16540:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1788448675.426498:0:16539:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1788448675.433735:0:16539:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788448675.434122:0:16539:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434144:0:16539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434151:0:16539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434159:0:16539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434168:0:16539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434894:0:16539:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434902:0:16539:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434952:0:16539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.434969:0:16539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 12 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.434984:0:16539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978432:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448675.435152:0:16539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.435160:0:16539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 12 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.435169:0:16539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978560:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448675.435228:0:16539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.435236:0:16539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.435246:0:16539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978688:0@lo:104: 00000100:00100000:0.0:1788448675.435288:0:16539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448675.435342:0:16539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.435350:0:16539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 18 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.435358:0:16539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978816:0@lo:104: 00000100:00100000:0.0:1788448675.435379:0:16539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788448675.435411:0:16539:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 18 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.435418:0:16539:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 18 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.435426:0:16539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978944:0@lo:104: 00000100:00100000:0.0:1788448675.435450:0:16539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448675.435459:0:16539:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba7c480 going to sleep for 11 seconds 00000100:00100000:3.0:1788448675.435639:0:14404:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788448675.435653:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978688 00000100:00100000:3.0:1788448675.435659:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978688 00000100:00100000:3.0:1788448675.435696:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978816 00000100:00100000:3.0:1788448675.435698:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978816 00000100:00100000:3.0:1788448675.435706:0:14404:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926978944 00000100:00100000:3.0:1788448675.435708:0:14404:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926978944 00000100:00100000:3.0:1788448675.435720:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448675.435730:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+5:16539:x1875323926978688:12345-0@lo:104: 00010000:00010000:3.0:1788448675.435742:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.435805:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788448675.435812:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+5:16539:x1875323926978688:12345-0@lo:104: Request processed in 84us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448675.435821:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788448675.435841:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448675.435847:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+4:16539:x1875323926978816:12345-0@lo:104: 00010000:00010000:3.0:1788448675.435855:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.435888:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788448675.435893:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+4:16539:x1875323926978816:12345-0@lo:104: Request processed in 47us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448675.435910:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788448675.435923:0:14404:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788448675.435929:0:14404:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cc87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:16539:x1875323926978944:12345-0@lo:104: 00010000:00010000:3.0:1788448675.435937:0:14404:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.435971:0:14404:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788448675.435976:0:14404:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cc87450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5961e328-478c-41d0-979d-0dab1f06ac13+3:16539:x1875323926978944:12345-0@lo:104: Request processed in 48us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448675.435982:0:14404:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788448675.436041:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788448675.436047:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436054:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a83fc39400 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448675.436059:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436067:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448675.436075:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448675.436081:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448675.436116:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436123:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448675.436148:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436156:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a83fc39400/0xd0e9b344b90ac0fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90ac103 expref: -99 pid: 15825 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436172:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788448675.436175:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436182:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758200 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448675.436212:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436219:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448675.436225:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448675.436231:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448675.436249:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436254:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448675.436267:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436274:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810758200/0xd0e9b344b90abfc8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abfcf expref: -99 pid: 15104 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436295:0:14410:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788448675.436298:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436303:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810629600 already unused, calling callback (ffffffffc1c4ac20) 10000000:00010000:3.0:1788448675.436306:0:14410:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436312:0:14410:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788448675.436318:0:14410:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788448675.436324:0:14410:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788448675.436338:0:14410:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436344:0:14410:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788448675.436350:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436355:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.137@tcp lock: ffff99a810629600/0xd0e9b344b90abf7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xd0e9b344b90abf82 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.436371:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448675.436372:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448675.436374:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448675.436381:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788448675.436392:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448675.436411:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926979072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448675.436445:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448675.436485:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5961e328-478c-41d0-979d-0dab1f06ac13:3312:1875323926979328:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448675.436506:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448675.436655:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926979200:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788448675.436684:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448675.436724:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979072 00000100:00100000:1.0:1788448675.436728:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979072 00010000:00010000:1.0:1788448675.436750:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 19 pid: 14415 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.436764:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979328 00000100:00100000:1.0:1788448675.436766:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979328 00010000:00010000:1.0:1788448675.436777:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 20 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.436785:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979200 00000100:00100000:1.0:1788448675.436787:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979200 00010000:00010000:1.0:1788448675.436798:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 21 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.436809:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448675.436815:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+21:3310:x1875323926979072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448675.436825:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448675.436829:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 21 pid: 14415 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.436845:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 21 pid: 14415 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.436861:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448675.436900:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+21:3310:x1875323926979072:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448675.436907:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788448675.436922:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448675.436928:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+20:3312:x1875323926979328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448675.436935:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448675.436940:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 20 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.436946:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 20 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.436955:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448675.436975:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+20:3312:x1875323926979328:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448675.436982:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788448675.436994:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448675.437000:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80872e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926979200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788448675.437018:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448675.437023:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 19 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.437030:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 19 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.437047:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448675.437073:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80872e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926979200:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448675.437079:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788448675.437135:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926979200:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788448675.437231:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810629000/0xd0e9b344b90ac103 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90ac0fc expref: 18 pid: 14415 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.437242:0:16539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978688:0@lo:104: 00010000:00010000:0.0:1788448675.437253:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc39600/0xd0e9b344b90abfcf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90abfc8 expref: 17 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.437260:0:16539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978816:0@lo:104: 00010000:00010000:0.0:1788448675.437268:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a83fc38000/0xd0e9b344b90abf82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xd0e9b344b90abf7b expref: 16 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.437276:0:16539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978944:0@lo:104: 00000100:00100000:2.0:1788448675.437781:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926979072:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788448675.438034:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834d3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5961e328-478c-41d0-979d-0dab1f06ac13:3312:1875323926979328:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788448675.445430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448675.445511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448675.445593:0:16539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978432:192.168.204.37@tcp:104: 00000100:00100000:0.0:1788448675.445624:0:16539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83cdfed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16539:1875323926978560:192.168.204.37@tcp:104: 00010000:00010000:0.0:1788448675.445661:0:16539:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.452589:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870144 00000100:00100000:1.0:1788448675.452605:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870144 00000100:00100000:0.0:1788448675.452747:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870272 00000100:00100000:0.0:1788448675.452757:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870272 00010000:00010000:0.0:1788448675.452808:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 14 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.452843:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448675.452853:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+14:2352:x1875323902870272:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448675.452870:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448675.452877:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 14 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.452893:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 14 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448675.452894:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 14 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.452926:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:0.0:1788448675.452926:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810758c00/0xd0e9b344b90ac229 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ddf expref: 14 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448675.452937:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:0.0:1788448675.452949:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448675.453248:0:14406:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788448675.453264:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:3.0:1788448675.453275:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2352:x1875323902870144:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788448675.453284:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448675.453290:0:14406:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 13 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453302:0:14406:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 13 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453313:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a8092ec400/0xd0e9b344b90ac261 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e41 expref: 13 pid: 14413 timeout: 636 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453325:0:14406:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453333:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448675.453382:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:2352:x1875323902870272:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 529us (7876us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448675.453391:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00010000:00010000:3.0:1788448675.453422:0:14406:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453429:0:14406:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453449:0:14406:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453455:0:14406:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453460:0:14406:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:3.0:1788448675.453465:0:14406:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.453472:0:14406:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.455318:0:14406:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448675.455343:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788448675.455663:0:16539:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.455674:0:16539:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448675.455695:0:16539:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac28b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16539 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448675.457990:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:2352:x1875323902870144:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 4701us (12553us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448675.458018:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00010000:00010000:3.0:1788448675.744462:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448675.937863:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926979456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448675.937928:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448675.938068:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979456 00000100:00100000:0.0:1788448675.938076:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979456 00000100:00100000:0.0:1788448675.938145:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788448675.938156:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926979456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448675.938206:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448675.938252:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3309:x1875323926979456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448675.938259:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1788448675.938642:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448675.938677:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3309:1875323926979456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788448676.596599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448676.596705:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870400 00000100:00100000:3.0:1788448676.596716:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870400 00000100:00100000:3.0:1788448676.596771:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:3.0:1788448676.596782:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+11:13767:x1875323902870400:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788448676.596800:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448676.596819:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a706b6bc00/0xd0e9b344b90ac292 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e72 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448676.596857:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a706b6bc00/0xd0e9b344b90ac292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e72 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448676.596867:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a706b6bc00/0xd0e9b344b90ac292 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e72 expref: 12 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448676.596876:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6bc00, rc 0) 00000100:00100000:3.0:1788448676.596957:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870400:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 176us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448676.596964:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 106 00000100:00100000:0.0:1788448676.604659:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448676.604895:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870528 00000100:00100000:2.0:1788448676.604906:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870528 00000100:00100000:2.0:1788448676.604960:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:2.0:1788448676.604970:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870528:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448676.605323:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870528:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 353us (670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448676.605332:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 107 00000100:00100000:2.0:1788448676.608980:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448676.611563:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870656 00000100:00100000:1.0:1788448676.611579:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870656 00000100:00100000:1.0:1788448676.611780:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:1.0:1788448676.611793:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870656:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788448676.612045:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870656:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 254us (3072us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448676.612053:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 108 00000100:00100000:0.0:1788448676.626255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448676.626435:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870784 00000100:00100000:0.0:1788448676.626446:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870784 00000100:00100000:0.0:1788448676.626498:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:0.0:1788448676.626510:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+12:13767:x1875323902870784:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448676.626536:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448676.626556:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac299 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e79 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448676.626656:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e79 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448676.626669:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a810759400/0xd0e9b344b90ac299 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e79 expref: 13 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448676.626786:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759400, rc 0) 00000100:00100000:0.0:1788448676.626955:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13767:x1875323902870784:12345-192.168.204.37@tcp:101:ll_cfg_requeue.0 Request processed in 446us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448676.626963:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 109 00000100:00100000:2.0:1788448676.632753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448676.632963:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902870912 00000100:00100000:3.0:1788448676.632974:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902870912 00000100:00100000:3.0:1788448676.633042:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:3.0:1788448676.633054:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13767:x1875323902870912:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448676.633448:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13767:x1875323902870912:12345-192.168.204.37@tcp:501:ll_cfg_requeue.0 Request processed in 395us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448676.633457:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 110 00000100:00100000:3.0:1788448676.637521:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448676.637745:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871040 00000100:00100000:0.0:1788448676.637756:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871040 00000100:00100000:0.0:1788448676.637820:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 111 00000100:00100000:0.0:1788448676.637830:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13767:x1875323902871040:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788448676.638094:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:13767:x1875323902871040:12345-192.168.204.37@tcp:503:ll_cfg_requeue.0 Request processed in 263us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448676.638115:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 111 00010000:00010000:3.0:1788448676.769400:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788448677.152540:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788448677.152548:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a7073be800 from 10 10000000:01000000:3.0:1788448677.152553:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788448677.152606:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448677.152618:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448677.152646:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448677.152673:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788448677.152740:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448677.152823:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.159477:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979584 00000100:00100000:2.0:1788448677.159494:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979584 00000100:00100000:2.0:1788448677.159554:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788448677.159573:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+16:14417:x1875323926979584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448677.159593:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448677.159615:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842179e00/0xd0e9b344b90ac2a7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac2a0 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.159643:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179e00/0xd0e9b344b90ac2a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2a0 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.159656:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842179e00/0xd0e9b344b90ac2a7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2a0 expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.159665:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179e00, rc 0) 00000100:00100000:2.0:1788448677.159738:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (6998us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.159744:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788448677.160551:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a83563a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788448677.160569:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2a7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448677.160577:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac2a7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448677.160642:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788448677.160735:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448677.160765:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448677.161179:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979712 00000100:00100000:3.0:1788448677.161201:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979712 00000100:00100000:3.0:1788448677.161244:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788448677.161252:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448677.161493:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 240us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448677.161500:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788448677.161532:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788448677.161567:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835638e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448677.161608:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448677.161625:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a83547bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788448677.161637:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979840 00000100:00100000:3.0:1788448677.161641:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979840 00000100:00100000:3.0:1788448677.161663:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448677.161669:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788448677.161805:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448677.161812:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788448677.161854:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835638e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788448677.164296:0:16609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1788448677.167110:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1788448677.167148:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788448677.167159:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2a7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448677.167207:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a706b6a800/0xd0e9b344b90ac2a0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2a7 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788448677.167219:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788448677.167222:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a834854800 from 10 10000000:01000000:0.0:1788448677.167225:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788448677.167265:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448677.167273:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448677.167283:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448677.167309:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788448677.167379:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448677.167424:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.167628:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926979968 00000100:00100000:2.0:1788448677.167644:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926979968 00000100:00100000:2.0:1788448677.167696:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788448677.167706:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+17:14417:x1875323926979968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448677.167718:0:14415:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448677.167730:0:14415:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842179200/0xd0e9b344b90ac2b5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac2ae expref: -99 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.167754:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179200/0xd0e9b344b90ac2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2ae expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.167764:0:14415:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842179200/0xd0e9b344b90ac2b5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2ae expref: 18 pid: 14415 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.167773:0:14415:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179200, rc 0) 00000100:00100000:2.0:1788448677.167817:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926979968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 114us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.167824:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788448677.167870:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926979968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448677.167884:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2b5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.167893:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac2b5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448677.167945:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.167970:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.168007:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.168020:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980096 00000100:00100000:2.0:1788448677.168033:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980096 00000100:00100000:2.0:1788448677.168057:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448677.168063:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926980096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.168382:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926980096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 318us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.168389:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788448677.168425:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.168454:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.168493:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.168514:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.168525:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980224 00000100:00100000:2.0:1788448677.168528:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980224 00000100:00100000:2.0:1788448677.168551:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448677.168557:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926980224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.168699:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926980224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 142us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.168705:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788448677.168742:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980224:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788448677.169404:0:16610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1788448677.169457:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1788448677.169475:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788448677.169484:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2b5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169494:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a810759000/0xd0e9b344b90ac2ae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2b5 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788448677.169517:0:14417:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788448677.169520:0:14417:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff99a70705f000 from 10 10000000:01000000:2.0:1788448677.169523:0:14417:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788448677.169548:0:14417:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169556:0:14417:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169567:0:14417:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448677.169583:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.169619:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.169644:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.169658:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980352 00000100:00100000:2.0:1788448677.169662:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980352 00000100:00100000:2.0:1788448677.169690:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788448677.169698:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+18:14417:x1875323926980352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448677.169707:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448677.169718:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff99a842179800/0xd0e9b344b90ac2c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xd0e9b344b90ac2bc expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169739:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff99a842179800/0xd0e9b344b90ac2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2bc expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169749:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff99a842179800/0xd0e9b344b90ac2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xd0e9b344b90ac2bc expref: 19 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169766:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a842179800, rc 0) 00000100:00100000:2.0:1788448677.169797:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926980352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.169804:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788448677.169842:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788448677.169854:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2c3 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448677.169862:0:14417:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xd0e9b344b90ac2c3 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448677.169898:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.169922:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.169934:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.169946:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980480 00000100:00100000:2.0:1788448677.169949:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980480 00000100:00100000:2.0:1788448677.169969:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788448677.169986:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926980480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.170208:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926980480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 209us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.170215:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788448677.170244:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.170268:0:14417:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.170305:0:14417:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.170332:0:14417:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757b840 going to sleep for 11 seconds 00000100:00100000:2.0:1788448677.170343:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980608 00000100:00100000:2.0:1788448677.170346:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980608 00000100:00100000:2.0:1788448677.170367:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788448677.170373:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926980608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788448677.171452:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5961e328-478c-41d0-979d-0dab1f06ac13+19:14417:x1875323926980608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1073us (1140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.171462:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788448677.180593:0:14417:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704687100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5961e328-478c-41d0-979d-0dab1f06ac13:14417:1875323926980608:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788448677.186707:0:16612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1788448677.186904:0:14417:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1788448677.186935:0:14417:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.137@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788448677.186947:0:14417:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2c3 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448677.186958:0:14417:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.137@tcp lock: ffff99a842178a00/0xd0e9b344b90ac2bc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xd0e9b344b90ac2c3 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448677.473442:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926980736:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448677.473521:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448677.473603:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980736 00000100:00100000:2.0:1788448677.473611:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980736 00000100:00080000:1.0:1788448677.473652:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788448677.473665:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788448677.473674:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926980736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788448677.473703:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1788448677.473765:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926980736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448677.473773:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448677.474244:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926980736:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788448677.478463:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926980864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478546:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448677.478588:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926981376:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448677.478648:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448677.478654:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926980992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478683:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448677.478712:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926981120:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478738:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448677.478760:0:3309:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788448677.478765:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926981248:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478789:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448677.478826:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980864 00000100:00100000:1.0:1788448677.478833:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980864 00000100:00100000:1.0:1788448677.478881:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788448677.478891:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926980864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.478942:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e72ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5961e328-478c-41d0-979d-0dab1f06ac13+19:3311:x1875323926980864:12345-0@lo:400:kworker.0 Request processed in 53us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448677.478950:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788448677.479004:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926980992 00000100:00100000:1.0:1788448677.479009:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926980992 00000100:00100000:1.0:1788448677.479060:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448677.479068:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926980992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479104:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926980992:12345-0@lo:400:kworker.0 Request processed in 38us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448677.479121:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788448677.479139:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926981376 00000100:00100000:1.0:1788448677.479142:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926981376 00000100:00100000:1.0:1788448677.479170:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926981120 00000100:00100000:1.0:1788448677.479174:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926981120 00000100:00100000:1.0:1788448677.479221:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926981248 00000100:00100000:1.0:1788448677.479224:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926981248 00000100:00100000:1.0:1788448677.479243:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448677.479249:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926981376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479282:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1875323926981376:12345-0@lo:400:kworker.0 Request processed in 32us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448677.479288:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788448677.479300:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788448677.479306:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926981120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479347:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1875323926981120:12345-0@lo:400:kworker.0 Request processed in 40us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448677.479353:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788448677.479365:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448677.479371:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926981248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479398:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926981248:12345-0@lo:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448677.479403:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788448677.479446:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926980992:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479456:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5961e328-478c-41d0-979d-0dab1f06ac13:3311:1875323926980864:0@lo:400:kworker.0 00000100:00100000:1.0:1788448677.479465:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3311:1875323926981376:0@lo:400:kworker.0 00000100:00100000:2.0:1788448677.479493:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926981248:0@lo:400:kworker.0 00000100:00080000:1.0:1788448677.479507:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448677.479508:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3309:1875323926981120:0@lo:400:kworker.0 00000100:00080000:1.0:1788448677.479514:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788448677.793176:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788448678.177111:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788448678.816481:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788448678.837610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448678.837657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448678.838091:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871168 00000100:00100000:2.0:1788448678.838103:0:14414:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871168 00000100:00100000:2.0:1788448678.838166:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:2.0:1788448678.838177:0:14414:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2354:x1875323902871168:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448678.838290:0:14414:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2354:x1875323902871168:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 114us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448678.838311:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 122 00000100:00100000:3.0:1788448678.838540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448678.838562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448678.841683:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871680 00000100:00100000:2.0:1788448678.841698:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871680 00000100:00100000:2.0:1788448678.841801:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:2.0:1788448678.841815:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83563a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2354:x1875323902871680:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448678.841898:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83563a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2354:x1875323902871680:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 88us (3359us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448678.841905:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00080000:1.0:1788448678.842356:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448678.845702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448678.845734:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448678.846567:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871296 00000100:00100000:1.0:1788448678.846579:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871296 00000100:00100000:1.0:1788448678.846655:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:1.0:1788448678.846685:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+6:2354:x1875323902871296:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448678.846780:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+6:2354:x1875323902871296:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 104us (1095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448678.846788:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00080000:1.0:1788448678.846813:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788448678.847588:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871424 00000100:00100000:2.0:1788448678.847596:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871424 00000100:00100000:2.0:1788448678.847861:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871936 00000100:00100000:2.0:1788448678.847866:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871936 00000100:00100000:3.0:1788448678.848108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448678.848151:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871552 00000100:00100000:3.0:1788448678.848155:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871552 00000100:00080000:1.0:1788448678.848329:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448678.848333:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448678.848344:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902871808 00000100:00100000:1.0:1788448678.848348:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902871808 00000100:00100000:1.0:1788448678.848595:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1788448678.848607:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2354:x1875323902871424:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448678.848853:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2354:x1875323902871424:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 247us (11193us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448678.848861:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:1.0:1788448678.848878:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:1.0:1788448678.848885:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2354:x1875323902871808:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448678.848909:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2354:x1875323902871808:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 25us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448678.848914:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00080000:1.0:1788448678.849092:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448678.849224:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:2.0:1788448678.849233:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2354:x1875323902871936:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:2.0:1788448678.849658:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835638000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2354:x1875323902871936:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 423us (11092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448678.850024:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1788448678.850646:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448678.850657:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+5:2354:x1875323902871552:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:3.0:1788448678.851142:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+5:2354:x1875323902871552:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 486us (5405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448678.851150:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1788448679.292328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448679.292431:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872064 00000100:00100000:2.0:1788448679.292442:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872064 00000100:00100000:2.0:1788448679.292509:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1788448679.292520:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+6:14424:x1875323902872064:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788448679.292539:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448679.292561:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179a00/0xd0e9b344b90ac2ca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e80 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292630:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292658:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292669:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292684:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292690:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.292697:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293023:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ac2df lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293032:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ac2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293039:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ac2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448679.293064:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448679.293068:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448679.293116:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ac2df lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293128:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293143:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293150:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293155:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a842179000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448679.293160:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293167:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293180:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:2.0:1788448679.293221:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448679.293226:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293232:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179000/0xd0e9b344b90ac2d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293246:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293251:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293257:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293261:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448679.293269:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293275:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293282:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff99a804d04f00) 00010000:00010000:2.0:1788448679.293285:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448679.293287:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293293:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac2d8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293327:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842179a00/0xd0e9b344b90ac2ca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e80 expref: 8 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293341:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031200/0xd0e9b344b90ac2df lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e80 expref: 7 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.293348:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a804d04000) 00010000:00010000:2.0:1788448679.293350:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448679.293352:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800031200, rc 0) 00000100:00100000:2.0:1788448679.293416:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:14424:x1875323902872064:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 898us (1098us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448679.293425:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:2.0:1788448679.299312:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.300375:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872320 00000100:00100000:1.0:1788448679.300386:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872320 00000100:00100000:1.0:1788448679.300457:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448679.300466:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:14424:x1875323902872320:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448679.300489:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448679.300509:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac2e6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e87 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300581:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300595:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300606:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300663:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300670:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300676:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.300999:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ac2fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.301007:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ac2fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.301022:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ac2fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448679.301032:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1788448679.304500:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304518:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304526:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304531:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448679.304536:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304542:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304560:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff99a804d04000) 00010000:00010000:1.0:1788448679.304562:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448679.304568:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304574:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac2ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304591:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304597:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304620:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304626:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448679.304630:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304636:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304646:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff99a808bbf200) 00010000:00010000:1.0:1788448679.304649:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448679.304652:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.304658:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac2f4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.307417:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac2e6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e87 expref: 10 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.307447:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed200/0xd0e9b344b90ac2fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e87 expref: 9 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.307457:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a808bbf100) 00010000:00010000:1.0:1788448679.307460:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448679.307463:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed200, rc 0) 00000100:00100000:1.0:1788448679.307845:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+9:14424:x1875323902872320:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 7376us (8543us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788448679.307870:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448679.326678:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448679.326793:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872448 00000100:00100000:2.0:1788448679.326803:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872448 00000100:00100000:2.0:1788448679.326868:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1788448679.326893:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+9:14424:x1875323902872448:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788448679.327013:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+9:14424:x1875323902872448:12345-192.168.204.37@tcp:59:lhsmtool_posix.0 Request processed in 123us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448679.327022:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:0.0:1788448679.401019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448679.401125:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872576 00000100:00100000:3.0:1788448679.401135:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872576 00000100:00100000:3.0:1788448679.401216:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1788448679.401241:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+9:14431:x1875323902872576:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448679.401264:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448679.401292:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac309 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e8e expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401371:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401387:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401402:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401417:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401425:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401432:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401638:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401647:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401654:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401670:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448679.401674:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401682:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401696:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:3.0:1788448679.401699:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448679.401704:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401710:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac310 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401723:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401728:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401734:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401739:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6a200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448679.401742:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401747:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401766:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a820d0f500) 00010000:00010000:3.0:1788448679.401768:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448679.401771:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401777:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac317 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401808:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac309 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e8e expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401818:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:3.0:1788448679.401820:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448679.401825:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac309 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e8e expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.401834:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6b400, rc 0) 00000100:00100000:3.0:1788448679.401913:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+9:14431:x1875323902872576:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 672us (904us total) trans 0 rc 301/301 00000100:00100000:3.0:1788448679.401920:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1788448679.416782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448679.417275:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872704 00000100:00100000:0.0:1788448679.417284:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872704 00000100:00100000:0.0:1788448679.417338:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448679.417348:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a047eef-0fdc-4732-b562-29a19de3e157+9:14431:x1875323902872704:12345-192.168.204.37@tcp:700:lfs.0 00000100:00100000:0.0:1788448679.417452:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdfd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:6a047eef-0fdc-4732-b562-29a19de3e157+9:14431:x1875323902872704:12345-192.168.204.37@tcp:700:lfs.0 Request processed in 105us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448679.417460:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1788448679.430367:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.432947:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902872960 00000100:00100000:1.0:1788448679.432965:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902872960 00000100:00100000:1.0:1788448679.433059:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1788448679.433070:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+9:14431:x1875323902872960:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:1.0:1788448679.433132:0:14422:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448679.433171:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a842178400/0xd0e9b344b90ac24c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e09 expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.433248:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:1.0:1788448679.433255:0:14422:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448679.433477:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.433491:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 5 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.433499:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.433535:0:14422:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 5 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.433549:0:14422:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 5 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448679.433564:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875323926981504:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448679.433862:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788448679.439400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448679.439543:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873088 00000100:00100000:0.0:1788448679.439553:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873088 00010000:00010000:0.0:1788448679.439610:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 6 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448679.439654:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:0.0:1788448679.439665:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2353:x1875323902873088:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448679.439679:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448679.439687:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 6 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.439699:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 6 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.439723:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:0.0:1788448679.439728:0:14408:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.439739:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.439745:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.439765:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448679.439853:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2353:x1875323902873088:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 189us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448679.439861:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00010000:00010000:2.0:1788448679.440143:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac284 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e6b expref: 5 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448679.440161:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14422:1875323926981504:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448679.440231:0:14422:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.440240:0:14422:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.440246:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.440278:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.440287:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.440296:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448679.441855:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788448679.441872:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441888:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441895:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441900:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448679.441906:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441914:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441942:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a804d04c00) 00010000:00010000:2.0:1788448679.441946:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448679.441951:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.441957:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac31e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788448679.441979:0:14422:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000984255ec reply state 00000000393823a0 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448679.441989:0:14422:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788448679.449782:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+10:14431:x1875323902872960:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 16701us (19414us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788448679.450462:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00010000:00010000:0.0:1788448679.456942:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.456962:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.456970:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.456976:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.456981:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.456989:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.457008:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a804d04f00) 00010000:00010000:0.0:1788448679.457011:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448679.457016:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.457021:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac325 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448679.569615:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.569835:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873216 00000100:00100000:1.0:1788448679.569844:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873216 00000100:00100000:1.0:1788448679.569914:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448679.569925:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+9:14439:x1875323902873216:12345-192.168.204.37@tcp:101:lctl.0 00010000:00010000:1.0:1788448679.569963:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448679.569986:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac32c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e95 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570051:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ac333 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570065:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ac333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570076:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ac333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448679.570112:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1788448679.570116:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448679.570153:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ac333 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570438:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac32c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e95 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570725:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec000/0xd0e9b344b90ac333 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e95 expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.570753:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448679.570756:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448679.570759:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec000, rc 0) 00000100:00100000:1.0:1788448679.570839:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83cdff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+10:14439:x1875323902873216:12345-192.168.204.37@tcp:101:lctl.0 Request processed in 916us (1233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448679.570848:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448679.620730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448679.620980:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873344 00000100:00100000:2.0:1788448679.620991:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873344 00000100:00100000:2.0:1788448679.621068:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:2.0:1788448679.621079:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+5:14440:x1875323902873344:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448679.621100:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448679.621122:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac33a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510e9c expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621318:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ac341 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621333:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ac341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621345:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ac341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448679.621382:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448679.621385:0:16303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448679.621406:0:16303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ac341 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621430:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac33a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e9c expref: 7 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621450:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030c00/0xd0e9b344b90ac341 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510e9c expref: 6 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.621458:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:2.0:1788448679.621461:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788448679.621465:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030c00, rc 0) 00000100:00100000:2.0:1788448679.621530:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+6:14440:x1875323902873344:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 453us (809us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448679.621545:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:3.0:1788448679.628426:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448679.628498:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873472 00000100:00100000:0.0:1788448679.628510:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873472 00000100:00100000:0.0:1788448679.628575:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:0.0:1788448679.628586:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:14440:x1875323902873472:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448679.628624:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448679.628645:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac348 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ea3 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628709:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628722:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628734:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628748:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628755:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628762:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628857:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628865:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628872:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448679.628902:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1788448679.628912:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448679.628946:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628961:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628968:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628974:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628980:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810759600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.628985:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.628992:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.629122:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:0.0:1788448679.629126:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448679.629131:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.629137:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac34f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.629151:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.629157:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.629172:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630653:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.630660:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630669:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630685:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a80bd82300) 00010000:00010000:0.0:1788448679.630688:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448679.630691:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630698:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630757:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac348 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ea3 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630773:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ea3 expref: 7 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.630780:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a80bd82600) 00010000:00010000:0.0:1788448679.630782:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788448679.630784:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758000, rc 0) 00000100:00100000:0.0:1788448679.630860:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+7:14440:x1875323902873472:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 2275us (2444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448679.630883:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 22 00000100:00100000:3.0:1788448679.637548:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.637836:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873728 00000100:00100000:1.0:1788448679.637847:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873728 00000100:00100000:1.0:1788448679.637908:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1788448679.637918:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+7:14440:x1875323902873728:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448679.637949:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448679.637972:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac364 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510eaa expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448679.638084:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788448679.638251:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac364 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eaa expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.638267:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448679.638270:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448679.638275:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac364 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eaa expref: 9 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.638289:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed600, rc 0) 00000100:00100000:1.0:1788448679.638353:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+8:14440:x1875323902873728:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 437us (816us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1788448679.638373:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 23 00000100:00100000:1.0:1788448679.644397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448679.644587:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902873984 00000100:00100000:3.0:1788448679.644598:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902873984 00000100:00100000:3.0:1788448679.644662:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 24 00000100:00100000:3.0:1788448679.644673:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+8:14440:x1875323902873984:12345-192.168.204.37@tcp:36:lfs.0 00010000:00010000:3.0:1788448679.644959:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788448679.644988:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac35d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ea3 expref: 8 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.645010:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a80bd82600) 00010000:00010000:3.0:1788448679.645020:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788448679.645058:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.645070:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.645080:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448679.645578:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ae55e7df reply state 000000009588f767 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448679.645589:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788448679.645597:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1788448679.646138:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+9:14440:x1875323902873984:12345-192.168.204.37@tcp:36:lfs.0 Request processed in 1463us (1747us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788448679.646147:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 24 00010000:00010000:0.0:1788448679.648992:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649010:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649019:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649026:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6a200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.649031:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649047:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649064:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f500) 00010000:00010000:0.0:1788448679.649067:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1788448679.649073:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.649079:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a200/0xd0e9b344b90ac372 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448679.655644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448679.656377:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902874240 00000100:00100000:3.0:1788448679.656389:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902874240 00000100:00100000:3.0:1788448679.656451:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1788448679.656462:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+8:14440:x1875323902874240:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448679.656746:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+9:14440:x1875323902874240:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 285us (1112us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788448679.656773:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1788448679.663107:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.663243:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902874496 00000100:00100000:1.0:1788448679.663253:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902874496 00000100:00100000:1.0:1788448679.663313:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:1.0:1788448679.663323:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+9:14440:x1875323902874496:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448679.663355:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448679.663375:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac379 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510eb1 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663449:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663464:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663476:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663492:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663512:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.663519:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448679.663635:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788448679.664034:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664052:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664058:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664064:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ece00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448679.664068:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664075:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664087:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448679.664090:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448679.664095:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664101:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac380 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664114:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664120:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664126:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664142:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448679.664145:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664151:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664159:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a808bbf800) 00010000:00010000:1.0:1788448679.664161:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448679.664164:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664170:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec400/0xd0e9b344b90ac387 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664275:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac379 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb1 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664286:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448679.664289:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448679.664292:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed600/0xd0e9b344b90ac379 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb1 expref: 11 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.664302:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed600, rc 0) 00000100:00100000:1.0:1788448679.664380:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49a983be-943b-4a5c-88b2-af962c3d45bc+10:14440:x1875323902874496:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1058us (1282us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1788448679.664388:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 25 00000100:00100000:2.0:1788448679.672789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448679.672908:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902874624 00000100:00100000:3.0:1788448679.672919:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902874624 00000100:00100000:3.0:1788448679.680919:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:3.0:1788448679.680955:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+10:14440:x1875323902874624:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448679.680981:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448679.681006:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac395 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510eb8 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681112:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681126:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681138:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448679.681164:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1788448679.681167:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1788448679.681201:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681229:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac395 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681247:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448679.681276:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:3.0:1788448679.681279:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788448679.681283:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6b600, rc 0) 00000100:00100000:3.0:1788448679.681354:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+11:14440:x1875323902874624:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 412us (8573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448679.681362:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 26 00000100:00100000:0.0:1788448679.698909:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448679.698985:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902874752 00000100:00100000:3.0:1788448679.698996:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902874752 00000100:00100000:3.0:1788448679.699054:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:3.0:1788448679.699065:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+11:14440:x1875323902874752:12345-192.168.204.37@tcp:37:lfs.0 00000100:00100000:2.0:1788448679.708658:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+11:14440:x1875323902874752:12345-192.168.204.37@tcp:37:lfs.0 Request processed in 9581us (9744us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448679.708675:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 3 00000100:00100000:2.0:1788448679.718253:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.718375:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875008 00000100:00100000:1.0:1788448679.718399:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875008 00000100:00100000:1.0:1788448679.718466:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 4 00000100:00100000:1.0:1788448679.718478:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7054b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+11:14440:x1875323902875008:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448679.718935:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7054b3c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+12:14440:x1875323902875008:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 448us (680us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1788448679.718943:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 4 00010000:00010000:3.0:1788448679.840520:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448679.859052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448679.861661:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875136 00000100:00100000:2.0:1788448679.861677:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875136 00000100:00100000:2.0:1788448679.861804:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:2.0:1788448679.861816:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+10:14446:x1875323902875136:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448679.861836:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448679.861859:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3a3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ebf expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.861948:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.861962:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.861973:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.861989:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.861995:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862019:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862111:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac3b8 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862118:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862125:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448679.862152:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1788448679.862156:0:16303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1788448679.862242:0:16303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac3b8 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862254:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862260:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862280:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862286:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448679.862290:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862297:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862316:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:2.0:1788448679.862318:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448679.862324:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862330:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac3aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862353:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862359:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862365:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862370:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448679.862373:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862378:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862384:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff99a804d04c00) 00010000:00010000:2.0:1788448679.862386:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448679.862389:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862394:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac3b1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862436:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3a3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ebf expref: 12 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862450:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030400/0xd0e9b344b90ac3b8 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ebf expref: 11 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.862457:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:2.0:1788448679.862459:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788448679.862462:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030400, rc 0) 00000100:00100000:2.0:1788448679.862538:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+11:14446:x1875323902875136:12345-192.168.204.37@tcp:101:bash.0 Request processed in 724us (3494us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448679.862545:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 27 00000100:00100000:3.0:1788448679.873437:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448679.873486:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875392 00000100:00100000:2.0:1788448679.873497:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875392 00000100:00100000:2.0:1788448679.873565:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 28 00000100:00100000:2.0:1788448679.873576:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+11:14446:x1875323902875392:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448679.873602:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448679.873624:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac3bf lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ec6 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.873742:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.873758:0:16303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.873767:0:16303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.873816:0:16303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.873829:0:16303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 11 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448679.873842:0:16303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926981632:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448679.874234:0:16303:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757ba80 going to sleep for 11 seconds 00000100:00100000:3.0:1788448679.893473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.893800:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875520 00000100:00100000:1.0:1788448679.893810:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875520 00010000:00010000:1.0:1788448679.893854:0:16541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 12 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448679.893895:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1788448679.893905:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+12:2353:x1875323902875520:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448679.893929:0:16541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448679.893937:0:16541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 12 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.893950:0:16541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 12 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.893972:0:16541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:1.0:1788448679.893978:0:16541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.893988:0:16541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.894011:0:16541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.894031:0:16541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448679.894497:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:49a983be-943b-4a5c-88b2-af962c3d45bc+12:2353:x1875323902875520:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 590us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448679.894506:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00010000:00010000:2.0:1788448679.897911:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b600/0xd0e9b344b90ac39c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510eb8 expref: 11 pid: 14420 timeout: 640 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448679.897949:0:16303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926981632:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448679.897975:0:16303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.897986:0:16303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.897993:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.898022:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.898035:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448679.898045:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.904125:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.904148:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.904176:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448679.906068:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448679.906129:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906140:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906148:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906153:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.906158:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906165:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906182:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:0.0:1788448679.906306:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448679.906312:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906318:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac3c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788448679.906345:0:16303:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000080ab62fc reply state 00000000abb965dc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448679.906373:0:16303:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788448679.906419:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac3bf lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 14 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906436:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 13 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.906444:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:0.0:1788448679.906446:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1788448679.906448:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758c00, rc 0) 00000100:00100000:0.0:1788448679.906529:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+14:14446:x1875323902875392:12345-192.168.204.37@tcp:101:bash.0 Request processed in 32954us (33100us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788448679.906538:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 28 00010000:00010000:0.0:1788448679.911560:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911580:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911588:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911594:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031e00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448679.911600:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911608:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911640:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a804d04c00) 00010000:00010000:0.0:1788448679.911643:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448679.911648:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448679.911654:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac3cd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448679.938602:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.938735:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875648 00000100:00100000:1.0:1788448679.938746:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875648 00000100:00100000:1.0:1788448679.938810:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:1.0:1788448679.938821:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+13:14446:x1875323902875648:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448679.938849:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448679.938871:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac3e2 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ecd expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.938967:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.938981:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.938993:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448679.939039:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788448679.939043:0:14422:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448679.939066:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.939096:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.939122:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac3e2 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ecd expref: 15 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.939140:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ecd expref: 14 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448679.939147:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448679.939150:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448679.939153:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec800, rc 0) 00000100:00100000:1.0:1788448679.941580:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+14:14446:x1875323902875648:12345-192.168.204.37@tcp:101:bash.0 Request processed in 2748us (2976us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448679.941592:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 29 00000100:00100000:2.0:1788448679.958154:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448679.965109:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902875904 00000100:00100000:1.0:1788448679.965125:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902875904 00000100:00100000:0.0:1788448679.966067:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:0.0:1788448679.966080:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+14:14446:x1875323902875904:12345-192.168.204.37@tcp:35:bash.0 00000100:00100000:0.0:1788448679.966477:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+15:14446:x1875323902875904:12345-192.168.204.37@tcp:35:bash.0 Request processed in 398us (8332us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1788448679.966486:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 5 00000100:00100000:2.0:1788448680.144579:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448680.144871:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902876160 00000100:00100000:3.0:1788448680.144892:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902876160 00000100:00100000:3.0:1788448680.144974:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00100000:3.0:1788448680.144985:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+15:14456:x1875323902876160:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:3.0:1788448680.145012:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448680.145035:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac3f0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ed4 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788448680.145134:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1788448680.145291:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac3f0 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ed4 expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.145325:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:3.0:1788448680.145339:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448680.145345:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac3f0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ed4 expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.145359:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6b400, rc 0) 00000100:00100000:3.0:1788448680.145429:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+16:14456:x1875323902876160:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 445us (859us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1788448680.145436:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 30 00000100:00080000:1.0:1788448680.146076:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448680.157454:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448680.158717:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902876416 00000100:00100000:0.0:1788448680.158729:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902876416 00000100:00100000:0.0:1788448680.158797:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 6 00000100:00100000:0.0:1788448680.158807:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+16:14456:x1875323902876416:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448680.159080:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:14456:x1875323902876416:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 273us (1635us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1788448680.159088:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 6 00000040:00080000:0.0:1788448680.225151:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788448680.244304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448680.244552:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902876672 00000100:00100000:0.0:1788448680.244563:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902876672 00000100:00100000:0.0:1788448680.244664:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:0.0:1788448680.244676:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:14459:x1875323902876672:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:0.0:1788448680.244718:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448680.244740:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac3fe lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510edb expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.244853:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac405 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.244868:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.244881:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac405 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448680.244892:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788448680.245061:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac3fe lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510edb expref: 20 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.245081:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac405 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510edb expref: 19 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.245090:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:0.0:1788448680.245093:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448680.245097:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758200, rc 0) 00000100:00100000:0.0:1788448680.245160:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+19:14459:x1875323902876672:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 486us (866us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1788448680.245167:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:2.0:1788448680.254690:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448680.254910:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902876800 00000100:00100000:3.0:1788448680.254929:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902876800 00000100:00100000:3.0:1788448680.254990:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1788448680.255001:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14459:x1875323902876800:12345-192.168.204.37@tcp:54:lfs.0 00010000:00010000:3.0:1788448680.255075:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255092:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255105:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255135:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255142:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255163:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255168:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448680.255172:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255179:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255237:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:3.0:1788448680.255241:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788448680.255245:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448680.255250:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac413 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448680.255321:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14459:x1875323902876800:12345-192.168.204.37@tcp:54:lfs.0 Request processed in 321us (640us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448680.255328:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:3.0:1788448680.255988:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448680.256051:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902876928 00000100:00100000:0.0:1788448680.256057:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902876928 00000100:00100000:0.0:1788448680.256108:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448680.256128:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a047eef-0fdc-4732-b562-29a19de3e157+19:2352:x1875323902876928:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448680.256141:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448680.256160:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac405 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510edb expref: 19 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.256178:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:0.0:1788448680.256181:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448680.256247:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a047eef-0fdc-4732-b562-29a19de3e157+18:2352:x1875323902876928:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 122us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448680.256254:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1788448680.261379:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448680.261774:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902877184 00000100:00100000:0.0:1788448680.261794:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902877184 00000100:00100000:0.0:1788448680.261843:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:0.0:1788448680.261853:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:14459:x1875323902877184:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:0.0:1788448680.262112:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+19:14459:x1875323902877184:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 259us (743us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1788448680.262121:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 7 00000100:00100000:2.0:1788448680.624976:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448680.625503:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902877440 00000100:00100000:1.0:1788448680.625517:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902877440 00000100:00100000:1.0:1788448680.625901:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:1.0:1788448680.625926:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+19:14490:x1875323902877440:12345-192.168.204.37@tcp:101:cat.0 00010000:00010000:1.0:1788448680.625959:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448680.625986:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac41a lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ee2 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.626141:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac421 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.626176:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac421 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.626213:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac421 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448680.626358:0:14422:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788448680.626562:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac41a lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee2 expref: 22 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.626677:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac421 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee2 expref: 21 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.626689:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448680.626692:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448680.626696:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ede00, rc 0) 00000100:00100000:1.0:1788448680.626924:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+21:14490:x1875323902877440:12345-192.168.204.37@tcp:101:cat.0 Request processed in 1002us (1964us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788448680.626934:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 33 00000100:00100000:3.0:1788448680.634091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448680.634149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448680.634462:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902877696 00000100:00100000:1.0:1788448680.634476:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902877696 00000100:00100000:1.0:1788448680.634561:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:1.0:1788448680.634585:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+21:14490:x1875323902877696:12345-192.168.204.37@tcp:35:cat.0 00000100:00100000:1.0:1788448680.635107:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+22:14490:x1875323902877696:12345-192.168.204.37@tcp:35:cat.0 Request processed in 521us (1027us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1788448680.635117:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 8 00000100:00100000:0.0:1788448680.636240:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902877824 00000100:00100000:0.0:1788448680.636257:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902877824 00000100:00100000:0.0:1788448680.636333:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:0.0:1788448680.636345:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a047eef-0fdc-4732-b562-29a19de3e157+22:2353:x1875323902877824:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448680.636362:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448680.636394:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ede00/0xd0e9b344b90ac421 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee2 expref: 22 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.636416:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:0.0:1788448680.636439:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448680.636489:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a047eef-0fdc-4732-b562-29a19de3e157+21:2353:x1875323902877824:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 146us (2339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448680.636496:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 1 00000100:00100000:3.0:1788448680.744670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448680.744826:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902878080 00000100:00100000:1.0:1788448680.744856:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902878080 00000100:00100000:1.0:1788448680.744962:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:1.0:1788448680.744974:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+21:14496:x1875323902878080:12345-192.168.204.37@tcp:101:dd.0 00010000:00010000:1.0:1788448680.745007:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448680.745049:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac42f lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ee9 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.745240:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac436 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.745257:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.745270:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac436 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448680.745284:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788448680.745475:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac42f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee9 expref: 24 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.745501:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac436 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee9 expref: 23 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.745510:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448680.745514:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448680.745517:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092eda00, rc 0) 00000100:00100000:1.0:1788448680.745599:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+23:14496:x1875323902878080:12345-192.168.204.37@tcp:101:dd.0 Request processed in 627us (944us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788448680.745607:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 34 00000100:00100000:0.0:1788448680.752504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448680.752609:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902878336 00000100:00100000:1.0:1788448680.752623:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902878336 00000100:00100000:1.0:1788448680.752699:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 35 00000100:00100000:1.0:1788448680.752712:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+23:14496:x1875323902878336:12345-192.168.204.37@tcp:36:dd.0 00010000:00010000:1.0:1788448680.752799:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1788448680.752833:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac436 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ee9 expref: 23 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.752857:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac3e9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ecd expref: 22 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.752870:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448680.752876:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448680.753238:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.753256:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448680.753268:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448680.753332:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788448680.753377:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000930829ca reply state 000000006b5c67b0 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448680.753387:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448680.753510:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:14496:x1875323902878336:12345-192.168.204.37@tcp:36:dd.0 Request processed in 799us (1020us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788448680.753519:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 35 00000020:00080000:1.0:1788448680.753544:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788448680.759257:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759282:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759291:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759298:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ece00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448680.759304:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759312:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759335:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:0.0:1788448680.759338:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448680.759343:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448680.759348:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ece00/0xd0e9b344b90ac444 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448680.859608:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448680.860014:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902878592 00000100:00100000:1.0:1788448680.860093:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902878592 00000100:00100000:1.0:1788448680.860296:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 9 00000100:00100000:1.0:1788448680.860311:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+23:14496:x1875323902878592:12345-192.168.204.37@tcp:35:dd.0 00000100:00100000:1.0:1788448680.860706:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+24:14496:x1875323902878592:12345-192.168.204.37@tcp:35:dd.0 Request processed in 396us (1112us total) trans 8589934611 rc 0/0 00000100:00100000:1.0:1788448680.860716:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 9 00010000:00010000:0.0:1788448680.864342:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448681.056675:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788448681.064103:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448681.064644:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902878720 00000100:00100000:3.0:1788448681.064657:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902878720 00000100:00100000:2.0:1788448681.065728:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 36 00000100:00100000:2.0:1788448681.065745:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+24:14510:x1875323902878720:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:2.0:1788448681.065778:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448681.065806:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac44b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ef0 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065891:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065929:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065944:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065964:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065972:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.065979:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.066237:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a8079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926981760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448681.066330:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448681.066446:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926981760 00000100:00100000:1.0:1788448681.066454:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926981760 00000100:00100000:1.0:1788448681.066506:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788448681.066513:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926981760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788448681.066550:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1788448681.066611:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926981760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448681.066619:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:1.0:1788448681.066665:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788448681.066734:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a8079a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926981760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788448681.069763:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.069785:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.069797:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448681.069853:0:14420:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788448681.069859:0:14420:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448681.070237:0:14420:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070254:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070264:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070272:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070279:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070285:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448681.070289:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070297:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070312:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:1.0:1788448681.070314:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448681.070319:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070324:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac452 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070351:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070371:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070377:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070382:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800030000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448681.070385:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070391:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070400:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a804d04400) 00010000:00010000:1.0:1788448681.070403:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448681.070406:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070412:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030000/0xd0e9b344b90ac459 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070510:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac44b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef0 expref: 26 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070525:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef0 expref: 25 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.070545:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448681.070548:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448681.070550:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec800, rc 0) 00000100:00100000:1.0:1788448681.070782:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+25:14510:x1875323902878720:12345-192.168.204.37@tcp:101:stat.0 Request processed in 5041us (6693us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448681.070791:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 36 00000001:00080000:1.0:1788448681.156794:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:1.0:1788448681.156828:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1788448681.156847:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1788448681.186064:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.186250:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902878976 00000100:00100000:1.0:1788448681.186264:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902878976 00000100:00100000:1.0:1788448681.186344:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 37 00000100:00100000:1.0:1788448681.186358:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+11:14516:x1875323902878976:12345-192.168.204.37@tcp:36:truncate.0 00010000:00010000:1.0:1788448681.186436:0:14421:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448681.186474:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac460 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef0 expref: 11 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.186501:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448681.186507:0:14421:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448681.187003:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.187021:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.187033:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448681.187123:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934612 00000004:00010000:1.0:1788448681.187155:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7355f4c reply state 0000000010f6c1b4 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.187165:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448681.187379:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+13:14516:x1875323902878976:12345-192.168.204.37@tcp:36:truncate.0 Request processed in 1022us (1328us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1788448681.187388:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 37 00000020:00080000:1.0:1788448681.187395:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448681.190257:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190276:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190284:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190291:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eda00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448681.190296:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190304:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190325:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.190328:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448681.190332:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.190338:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac467 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448681.456115:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.456376:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902879104 00000100:00100000:1.0:1788448681.456389:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902879104 00000100:00100000:1.0:1788448681.456465:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:1.0:1788448681.456475:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+12:14530:x1875323902879104:12345-192.168.204.37@tcp:101:stat.0 00010000:00010000:1.0:1788448681.456506:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448681.456531:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac46e lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510ef7 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456629:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456646:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456662:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456677:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456706:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.456713:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457076:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457087:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457094:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448681.457137:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00000004:00200000:1.0:1788448681.457141:0:16303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448681.457162:0:16303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457175:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457218:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457226:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457233:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457250:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ecc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448681.457255:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457265:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457280:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:1.0:1788448681.457283:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448681.457293:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457301:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac475 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457316:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457321:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457327:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457331:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448681.457334:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457341:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457358:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a808bbff00) 00010000:00010000:1.0:1788448681.457360:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448681.457363:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457369:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac47c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457408:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac46e lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 14 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457420:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 13 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.457427:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448681.457429:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448681.457431:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed800, rc 0) 00000100:00100000:1.0:1788448681.457515:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+13:14530:x1875323902879104:12345-192.168.204.37@tcp:101:stat.0 Request processed in 1041us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448681.457523:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 38 00000100:00100000:0.0:1788448681.584293:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.584413:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902879360 00000100:00100000:1.0:1788448681.584426:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902879360 00000100:00100000:1.0:1788448681.584520:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:1.0:1788448681.584533:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+13:14540:x1875323902879360:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:1.0:1788448681.584562:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448681.584601:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac48a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510efe expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448681.584771:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1788448681.584954:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac48a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510efe expref: 15 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.584972:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:1.0:1788448681.584975:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448681.584982:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac48a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510efe expref: 15 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.585001:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec800, rc 0) 00000100:00100000:1.0:1788448681.585082:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+14:14540:x1875323902879360:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 551us (804us total) trans 8589934614 rc 301/301 00000100:00100000:1.0:1788448681.585090:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 39 00000100:00100000:0.0:1788448681.597712:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448681.597995:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902879616 00000100:00100000:2.0:1788448681.598009:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902879616 00000100:00100000:1.0:1788448681.598278:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:1.0:1788448681.598503:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8087b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+14:14540:x1875323902879616:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:1.0:1788448681.599017:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8087b8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+15:14540:x1875323902879616:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 518us (1317us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1788448681.599035:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 10 00000100:00100000:0.0:1788448681.679429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.679565:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902879872 00000100:00100000:1.0:1788448681.679578:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902879872 00000100:00100000:1.0:1788448681.679658:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:1.0:1788448681.679671:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+15:14546:x1875323902879872:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448681.679705:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448681.679733:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac498 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f05 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.679907:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.679925:0:16303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 16 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.679934:0:16303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 16 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.679943:0:16303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.679986:0:16303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 16 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.680002:0:16303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 16 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.680290:0:16303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926981888:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448681.680578:0:16303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 16 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.680590:0:16303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 16 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.680600:0:16303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926982016:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448681.680640:0:16303:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a807409000 going to sleep for 11 seconds 00000100:00100000:0.0:1788448681.691694:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448681.691747:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448681.691845:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880000 00000100:00100000:2.0:1788448681.691857:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880000 00010000:00010000:2.0:1788448681.691923:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 17 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448681.691988:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880128 00000100:00100000:2.0:1788448681.691992:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880128 00010000:00010000:2.0:1788448681.692016:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 18 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448681.692044:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448681.692056:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a80872e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:2352:x1875323902880000:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448681.692075:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448681.692083:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 18 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692097:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 18 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692125:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.692131:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692141:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692148:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448681.692249:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a80872e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:2352:x1875323902880000:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 194us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448681.692258:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:2.0:1788448681.692318:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:2.0:1788448681.692325:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:2352:x1875323902880128:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448681.692341:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448681.692346:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 17 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692356:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 17 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692367:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.692371:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692379:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692388:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.692409:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448681.692429:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:2352:x1875323902880128:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 105us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448681.692437:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00010000:00010000:1.0:1788448681.694657:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac483 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ef7 expref: 16 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.694693:0:16303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1f480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926981888:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448681.694716:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac3d4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510ec6 expref: 15 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.694732:0:16303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:16303:1875323926982016:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448681.694765:0:16303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.694777:0:16303:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.694784:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448681.694812:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 1234567 00010000:00010000:1.0:1788448681.695126:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac498 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 16 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.695147:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 15 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.695158:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448681.695161:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788448681.695166:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec200, rc 0) 00000100:00100000:1.0:1788448681.695408:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+15:14546:x1875323902879872:12345-192.168.204.37@tcp:101:bash.0 Request processed in 15739us (16056us total) trans 8589934616 rc 0/0 00000100:00100000:1.0:1788448681.695420:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 40 00000100:00100000:0.0:1788448681.707403:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.712196:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880384 00000100:00100000:1.0:1788448681.712217:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880384 00000100:00100000:1.0:1788448681.712316:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 41 00000100:00100000:1.0:1788448681.712330:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+15:14546:x1875323902880384:12345-192.168.204.37@tcp:36:bash.0 00010000:00010000:1.0:1788448681.712700:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.712721:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.712735:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448681.712787:0:14421:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000004:00010000:1.0:1788448681.712815:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006f5ba083 reply state 00000000a53c64cb transno 8589934618 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.712824:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448681.712967:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:14546:x1875323902880384:12345-192.168.204.37@tcp:36:bash.0 Request processed in 638us (5579us total) trans 8589934618 rc 0/0 00000100:00100000:1.0:1788448681.712975:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 41 00000020:00080000:1.0:1788448681.712980:0:14421:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1788448681.716225:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716251:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716260:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716293:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448681.716299:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716308:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716331:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.716333:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788448681.716338:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.716344:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448681.716720:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448681.721124:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880512 00000100:00100000:2.0:1788448681.721148:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880512 00000100:00100000:2.0:1788448681.721268:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:2.0:1788448681.721282:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14546:x1875323902880512:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448681.721319:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448681.721348:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac4b4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f0c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.721445:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac4b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f0c expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.721466:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac4b4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f0c expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.721531:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.721535:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448681.721541:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030e00, rc 0) 00000100:00100000:2.0:1788448681.721639:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+18:14546:x1875323902880512:12345-192.168.204.37@tcp:101:bash.0 Request processed in 360us (4926us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448681.721648:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 42 00000100:00100000:0.0:1788448681.741240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.741396:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880640 00000100:00100000:1.0:1788448681.741411:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880640 00000100:00100000:1.0:1788448681.741493:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:1.0:1788448681.741505:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:14546:x1875323902880640:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448681.741568:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448681.741598:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4bb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f13 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.741731:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.741749:0:14421:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 19 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.741760:0:14421:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 4/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.741805:0:14421:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 19 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.741819:0:14421:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 19 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.741836:0:14421:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875323926982144:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448681.741982:0:14421:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80ba41cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788448681.752834:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448681.752965:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902880768 00000100:00100000:2.0:1788448681.752979:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902880768 00010000:00010000:2.0:1788448681.753060:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 20 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448681.753120:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448681.753132:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+20:2353:x1875323902880768:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448681.753152:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448681.753160:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 5/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 20 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.753176:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 20 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.753234:0:14407:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:2.0:1788448681.753241:0:14407:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.753253:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.753286:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 4/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.753314:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788448681.753386:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+20:2353:x1875323902880768:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 255us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448681.753394:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00010000:00010000:1.0:1788448681.754129:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac49f lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f05 expref: 19 pid: 16303 timeout: 642 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448681.754155:0:14421:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14421:1875323926982144:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448681.754271:0:14421:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.754299:0:14421:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.754306:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448681.754370:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788448681.754376:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448681.754401:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.754444:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4bb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f13 expref: 19 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.754461:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f13 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.754469:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:1.0:1788448681.754472:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788448681.754476:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ecc00, rc 0) 00000100:00100000:1.0:1788448681.754549:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:14546:x1875323902880640:12345-192.168.204.37@tcp:101:bash.0 Request processed in 13045us (13368us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448681.754559:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 43 00000100:00100000:0.0:1788448681.762841:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448681.768325:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881024 00000100:00100000:3.0:1788448681.768347:0:14406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881024 00000100:00100000:3.0:1788448681.768753:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:3.0:1788448681.768768:0:14406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a047eef-0fdc-4732-b562-29a19de3e157+18:14546:x1875323902881024:12345-192.168.204.37@tcp:103:bash.0 00010000:00010000:3.0:1788448681.768792:0:14406:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1788448681.768832:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4c2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f13 expref: 18 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448681.768866:0:14406:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800030e00/0xd0e9b344b90ac4b4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f0c expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448681.768881:0:14406:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a80bd82300) 00010000:00010000:3.0:1788448681.768909:0:14406:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448681.769408:0:14406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:6a047eef-0fdc-4732-b562-29a19de3e157+16:14546:x1875323902881024:12345-192.168.204.37@tcp:103:bash.0 Request processed in 251us (6189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448681.769420:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 2 00000100:00100000:0.0:1788448681.773712:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448681.773822:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881152 00000100:00100000:2.0:1788448681.773835:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881152 00000100:00100000:2.0:1788448681.773940:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:2.0:1788448681.773953:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+16:14546:x1875323902881152:12345-192.168.204.37@tcp:58:bash.0 00010000:00010000:2.0:1788448681.774148:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.774170:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448681.774234:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788448681.775157:0:14420:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788448681.775389:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1788448681.775474:0:14420:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1788448681.775622:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+16:14546:x1875323902881152:12345-192.168.204.37@tcp:58:bash.0 Request processed in 1664us (1918us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448681.775634:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 44 00000100:00100000:2.0:1788448681.781146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448681.781283:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881280 00000100:00100000:1.0:1788448681.781297:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881280 00000100:00100000:1.0:1788448681.781377:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 45 00000100:00100000:1.0:1788448681.781390:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+16:14546:x1875323902881280:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:1.0:1788448681.781550:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448681.781601:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f1a expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781684:0:14422:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781699:0:14422:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781724:0:14422:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781739:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781758:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:1.0:1788448681.781762:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788448681.781766:0:14422:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448681.781775:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ed800, rc 0) 00000100:00100000:1.0:1788448681.781915:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+17:14546:x1875323902881280:12345-192.168.204.37@tcp:101:bash.0 Request processed in 527us (784us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448681.781924:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 45 00010000:00010000:3.0:1788448681.888538:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788448682.272595:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448682.272609:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448682.272680:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788448682.272689:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1788448682.272892:0:14452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707769c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1875323926982272:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788448682.273055:0:14452:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80757ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788448682.283810:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.283810:0:14452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707769c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14452:1875323926982272:192.168.204.37@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788448682.284033:0:14431:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881408 00000100:00100000:3.0:1788448682.284043:0:14431:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881408 00000100:00100000:3.0:1788448682.284125:0:14431:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448682.284136:0:14432:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 2 min 2 max 256 00000100:00100000:3.0:1788448682.284139:0:14431:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881408:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788448682.284147:0:14432:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0002' 00000100:00080000:1.0:1788448682.284230:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448682.284955:0:14431:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881408:12345-192.168.204.37@tcp:900:lhsmtool_posix.0 Request processed in 813us (1154us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.284968:0:14431:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:0.0:1788448682.289339:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.290236:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881536 00000100:00100000:2.0:1788448682.290253:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881536 00000100:00100000:2.0:1788448682.290339:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:2.0:1788448682.290481:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881536:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448682.290532:0:14420:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448682.290704:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881536:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 354us (1380us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.290713:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 46 00000100:00100000:0.0:1788448682.301703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.301959:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881664 00000100:00100000:1.0:1788448682.301973:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881664 00000100:00100000:1.0:1788448682.302407:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:1.0:1788448682.302421:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881664:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.302562:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.302584:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.302599:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307542:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307643:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307658:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307694:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307703:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307710:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448682.307762:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788448682.307767:0:14421:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1788448682.307781:0:14421:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307792:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307813:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307820:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307827:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448682.307832:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307839:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307853:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a808bbf100) 00010000:00010000:1.0:1788448682.307856:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448682.307860:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307866:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac4d7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307895:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307902:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307908:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307913:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448682.307921:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307928:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307936:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff99a808bbff00) 00010000:00010000:1.0:1788448682.307938:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448682.307941:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307947:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac4de lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307963:0:14421:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307968:0:14421:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307973:0:14421:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307978:0:14421:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092edc00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448682.307980:0:14421:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307985:0:14421:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.307991:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:1.0:1788448682.307993:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788448682.308001:0:14421:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.308007:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac4e5 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.308112:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881664:12345-192.168.204.37@tcp:34:lhsmtool_posix.0 Request processed in 5689us (6419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448682.308123:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 47 00000100:00100000:0.0:1788448682.312317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.312392:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902881920 00000100:00100000:1.0:1788448682.312407:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902881920 00000100:00100000:1.0:1788448682.312730:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:1.0:1788448682.312742:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902881920:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.312765:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448682.312787:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f21 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.312905:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.312919:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.312930:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788448682.312942:0:16303:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788448682.314237:0:16303:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314252:0:16303:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314276:0:16303:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314282:0:16303:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:1.0:1788448682.314287:0:16303:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314295:0:16303:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314313:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:1.0:1788448682.314316:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788448682.314320:0:16303:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314328:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec800/0xd0e9b344b90ac4f3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314382:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4ec lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f21 expref: 19 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314393:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff99a808bbf100) 00010000:00010000:1.0:1788448682.314395:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788448682.314399:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ecc00/0xd0e9b344b90ac4ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f21 expref: 19 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.314409:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ecc00, rc 0) 00000100:00100000:1.0:1788448682.314484:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+18:14547:x1875323902881920:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1743us (2182us total) trans 8589934619 rc 301/301 00000100:00100000:1.0:1788448682.314501:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 48 00000100:00100000:3.0:1788448682.320896:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.328354:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902882048 00000100:00100000:2.0:1788448682.328371:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902882048 00000100:00100000:2.0:1788448682.328453:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:2.0:1788448682.328466:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+18:14547:x1875323902882048:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788448682.328508:0:14420:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788448682.328634:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+18:14547:x1875323902882048:12345-192.168.204.37@tcp:53:lhsmtool_posix.0 Request processed in 170us (7768us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.328641:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 49 00000100:00100000:0.0:1788448682.337893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.340507:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902882304 00000100:00100000:1.0:1788448682.340523:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902882304 00000100:00100000:1.0:1788448682.340747:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:1.0:1788448682.340758:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+18:14547:x1875323902882304:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.340779:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448682.340799:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac501 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f28 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788448682.348131:0:16303:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1788448682.348145:0:16303:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1788448682.348256:0:16303:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788448682.349289:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac508 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.349308:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac508 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.349335:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac508 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.349414:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092edc00/0xd0e9b344b90ac501 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f28 expref: 21 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.349435:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac508 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f28 expref: 20 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.349455:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a80bd82600) 00010000:00010000:0.0:1788448682.349458:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788448682.349462:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759600, rc 0) 00000100:00100000:0.0:1788448682.349557:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a8079a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+20:14547:x1875323902882304:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 8800us (11684us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1788448682.349644:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 50 00000100:00100000:3.0:1788448682.358331:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.358819:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902882560 00000100:00100000:2.0:1788448682.358835:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902882560 00000100:00100000:2.0:1788448682.358930:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:2.0:1788448682.358941:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+20:14547:x1875323902882560:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788448682.359005:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448682.359047:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac508 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f28 expref: 20 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.359071:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a80bd82600) 00010000:00010000:2.0:1788448682.359082:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788448682.359107:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.360015:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.360035:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361063:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361113:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361128:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361482:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361492:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361500:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361506:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448682.361511:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361521:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361548:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:3.0:1788448682.361552:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448682.361558:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361574:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031000/0xd0e9b344b90ac516 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361597:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361611:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361617:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361621:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b400 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448682.361624:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361631:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361641:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xb1b554f1 (ffff99a820d0ff00) 00010000:00010000:3.0:1788448682.361643:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448682.361646:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.361653:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac51d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xb1b554f1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.361828:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14547:x1875323902882560:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 2880us (3504us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788448682.361840:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 51 00000100:00100000:2.0:1788448682.365659:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.365829:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902882688 00000100:00100000:3.0:1788448682.365844:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902882688 00000100:00100000:3.0:1788448682.366217:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:3.0:1788448682.366233:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+19:14547:x1875323902882688:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448682.366261:0:14422:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448682.366311:0:14422:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a600/0xd0e9b344b90ac524 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f2f expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366368:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b000/0xd0e9b344b90ac52b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366386:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b000/0xd0e9b344b90ac52b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366400:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b000/0xd0e9b344b90ac52b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366549:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a600/0xd0e9b344b90ac524 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f2f expref: 21 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366571:0:14422:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b000/0xd0e9b344b90ac52b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f2f expref: 20 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.366592:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:3.0:1788448682.366596:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788448682.366600:0:14422:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6b000, rc 0) 00000100:00100000:3.0:1788448682.366700:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+20:14547:x1875323902882688:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 470us (1170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.366708:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 52 00000100:00100000:1.0:1788448682.372935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.373162:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902882944 00000100:00100000:0.0:1788448682.373177:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902882944 00000100:00100000:0.0:1788448682.373294:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 53 00000100:00100000:0.0:1788448682.373308:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+20:14547:x1875323902882944:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788448682.373718:0:14421:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.373741:0:14421:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.373766:0:14421:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788448682.376830:0:14421:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1788448682.376861:0:14421:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 542983673912ns, next at 543983668834ns, rc = 0 00000004:00010000:0.0:1788448682.377159:0:14421:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000059cc71fc reply state 00000000f18321f0 transno 8589934621 ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448682.377175:0:14421:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788448682.377550:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+22:14547:x1875323902882944:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 4238us (4622us total) trans 8589934621 rc 0/0 00000100:00100000:0.0:1788448682.377561:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 53 00010000:00010000:2.0:1788448682.381507:0:3295:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381539:0:3295:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381548:0:3295:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381556:0:3295:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758c00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448682.381562:0:3295:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381569:0:3295:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381602:0:3295:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:2.0:1788448682.381620:0:3295:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788448682.381628:0:3295:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.381634:0:3295:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758c00/0xd0e9b344b90ac532 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14421 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.384649:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.384903:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883072 00000100:00100000:0.0:1788448682.384919:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883072 00000100:00100000:0.0:1788448682.385014:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:0.0:1788448682.385028:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+21:14547:x1875323902883072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448682.385062:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448682.385089:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f36 expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.385174:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 22 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.385239:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 22 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.385266:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:0.0:1788448682.385269:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788448682.385273:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810758000, rc 0) 00000100:00100000:0.0:1788448682.385381:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+22:14547:x1875323902883072:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 355us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.385389:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 54 00000100:00100000:3.0:1788448682.390569:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.390836:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883200 00000100:00100000:2.0:1788448682.390850:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883200 00000100:00100000:2.0:1788448682.390964:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448682.390980:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+5:2353:x1875323902883200:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788448682.391502:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+6:2353:x1875323902883200:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 523us (943us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1788448682.391511:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00080000:3.0:1788448682.392224:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448682.395517:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.395798:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883456 00000100:00100000:0.0:1788448682.395812:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883456 00000100:00100000:0.0:1788448682.395940:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:0.0:1788448682.395952:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+22:14547:x1875323902883456:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788448682.396326:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+23:14547:x1875323902883456:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 374us (822us total) trans 8589934622 rc 0/0 00000100:00100000:0.0:1788448682.396335:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 11 00000100:00100000:1.0:1788448682.402015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.402379:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883712 00000100:00100000:3.0:1788448682.402393:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883712 00000100:00100000:3.0:1788448682.402475:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1788448682.402507:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+23:14547:x1875323902883712:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788448682.402888:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+23:14547:x1875323902883712:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 383us (907us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.402897:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 55 00000100:00100000:3.0:1788448682.406340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.406637:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883840 00000100:00100000:0.0:1788448682.406650:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883840 00000100:00100000:0.0:1788448682.406731:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:0.0:1788448682.406754:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+23:14547:x1875323902883840:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788448682.406783:0:16303:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788448682.406814:0:16303:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac540 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f3d expref: -99 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.406926:0:16303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.406947:0:16303:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.406967:0:16303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788448682.407339:0:16303:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1788448682.407459:0:16303:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 16303 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.407498:0:16303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac540 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f3d expref: 25 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.407526:0:16303:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f3d expref: 24 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.407536:0:16303:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:0.0:1788448682.407540:0:16303:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788448682.407544:0:16303:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a810759600, rc 0) 00000100:00100000:0.0:1788448682.408065:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6a047eef-0fdc-4732-b562-29a19de3e157+24:14547:x1875323902883840:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 1318us (1735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.408077:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 56 00000100:00100000:3.0:1788448682.418289:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.418363:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902883968 00000100:00100000:1.0:1788448682.418378:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902883968 00000100:00100000:1.0:1788448682.418463:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:1.0:1788448682.418477:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+6:2352:x1875323902883968:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.418503:0:15107:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788448682.418534:0:15107:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f44 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788448682.418584:0:15107:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a998fa9, blocks: 0x1 00010000:00010000:1.0:1788448682.418610:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=543s v=(0 0) 00010000:00010000:1.0:1788448682.418616:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788448682.418629:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 7 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.418654:0:15107:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 7 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.418693:0:15107:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a8092ec600, rc 0) 00000100:00100000:1.0:1788448682.418777:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:2352:x1875323902883968:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 290us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448682.418785:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1788448682.427865:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.428002:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884224 00000100:00100000:1.0:1788448682.428016:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884224 00000100:00100000:1.0:1788448682.428100:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:1.0:1788448682.428112:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:14547:x1875323902884224:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788448682.428302:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:14547:x1875323902884224:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 191us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448682.428312:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 57 00000100:00100000:2.0:1788448682.433355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.433892:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884352 00000100:00100000:3.0:1788448682.433907:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884352 00000100:00100000:3.0:1788448682.433992:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:3.0:1788448682.434010:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+24:14547:x1875323902884352:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788448682.542051:0:5859:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000004:00080000:3.0:1788448682.542074:0:5859:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1788448682.542352:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+13:14547:x1875323902884352:12345-192.168.204.37@tcp:44:lhsmtool_posix.0 Request processed in 108342us (109016us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.542364:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 58 00000100:00100000:1.0:1788448682.542412:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788448682.542440:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a834f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926982400:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788448682.542545:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448682.542858:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926982400 00000100:00100000:0.0:1788448682.542883:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926982400 00000100:00100000:0.0:1788448682.542963:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788448682.542976:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1875323926982400:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1788448682.543236:0:15108:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788448682.543240:0:15108:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1788448682.543243:0:15108:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788448682.543245:0:15108:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788448681 -> 1788448681 00002000:00010000:0.0:1788448682.543248:0:15108:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1788448682.543309:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834f1f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1875323926982400:12345-0@lo:2:osp-syn-0-0.0 Request processed in 335us (777us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1788448682.543336:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1788448682.543414:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff99a834f1ed80/2, rc 0, transno 8589934595 00000100:00100000:3.0:1788448682.543426:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a834f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3310:1875323926982400:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1788448682.546326:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.546436:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884480 00000100:00100000:1.0:1788448682.546455:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884480 00000100:00100000:1.0:1788448682.546554:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:1.0:1788448682.546569:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:2353:x1875323902884480:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788448682.546746:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:2353:x1875323902884480:12345-192.168.204.37@tcp:16:lhsmtool_posix.0 Request processed in 180us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448682.546755:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:3.0:1788448682.550173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.550541:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884736 00000100:00100000:1.0:1788448682.550556:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884736 00000100:00100000:1.0:1788448682.550652:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:1.0:1788448682.550689:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+13:14547:x1875323902884736:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.550784:0:14420:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448682.550821:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810759600/0xd0e9b344b90ac547 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f3d expref: 13 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.550847:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:1.0:1788448682.550853:0:14420:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788448682.550910:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.550929:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.550942:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788448682.552236:0:14420:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007046a07d reply state 00000000f57fc713 transno 8589934623 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.552255:0:14420:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788448682.552559:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+14:14547:x1875323902884736:12345-192.168.204.37@tcp:36:lhsmtool_posix.0 Request processed in 1868us (2398us total) trans 8589934623 rc 0/0 00000100:00100000:1.0:1788448682.552576:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 59 00000100:00100000:2.0:1788448682.559867:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.560548:0:15108:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884864 00000100:00100000:3.0:1788448682.560564:0:15108:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884864 00000100:00100000:3.0:1788448682.560654:0:15108:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:3.0:1788448682.560667:0:15108:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:14547:x1875323902884864:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788448682.560691:0:15108:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788448682.560717:0:15108:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f4b expref: -99 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.560890:0:15108:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 8 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.560924:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448682.560930:0:15108:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788448682.560937:0:15108:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 8 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.561004:0:15108:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 8 pid: 15107 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.561022:0:15108:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 8 pid: 15107 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.561041:0:15108:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875323926982528:192.168.204.37@tcp:104: 00000100:00100000:3.0:1788448682.561180:0:15108:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a80923c780 going to sleep for 11 seconds 00000100:00100000:3.0:1788448682.567048:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.567350:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902884992 00000100:00100000:2.0:1788448682.567364:0:14407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902884992 00010000:00010000:2.0:1788448682.567426:0:14407:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 9 pid: 15107 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448682.567481:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:2.0:1788448682.567493:0:14407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+9:2353:x1875323902884992:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788448682.567513:0:14407:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788448682.567546:0:14407:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 9 pid: 15107 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.567601:0:14407:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 9 pid: 15107 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.567637:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448682.567643:0:14407:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448682.567651:0:14407:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.567662:0:14407:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.567711:0:14407:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448682.567730:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a707769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14407:1875323926982656:192.168.204.37@tcp:105: 00000100:00100000:2.0:1788448682.567845:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4600 going to sleep for 11 seconds 00010000:00010000:0.0:1788448682.569273:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569295:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569303:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569309:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448682.569315:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569324:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569342:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:0.0:1788448682.569346:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448682.569351:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.569358:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec200/0xd0e9b344b90ac555 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.572272:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a707769500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:14407:1875323926982656:192.168.204.37@tcp:105: 00010000:00010000:3.0:1788448682.572312:0:14407:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788448682.572389:0:14407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:6a047eef-0fdc-4732-b562-29a19de3e157+9:2353:x1875323902884992:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 4897us (5357us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.572403:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00010000:00010000:1.0:1788448682.573685:0:15108:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b9cfa897/0xd0e9b344b90ac54e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f44 expref: 8 pid: 15107 timeout: 643 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.573719:0:15108:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c6300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:15108:1875323926982528:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448682.573771:0:15108:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 7 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.573812:0:15108:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a706b6a600, rc 0) 00000100:00100000:1.0:1788448682.573899:0:15108:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:6a047eef-0fdc-4732-b562-29a19de3e157+7:14547:x1875323902884864:12345-192.168.204.37@tcp:101:lhsmtool_posix.0 Request processed in 13234us (14179us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448682.573910:0:15108:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:2.0:1788448682.578949:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.580125:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885120 00000100:00100000:1.0:1788448682.580144:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885120 00000100:00100000:2.0:1788448682.580386:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:2.0:1788448682.580401:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+7:2353:x1875323902885120:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1788448682.580705:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1788448682.580710:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1788448680 00002000:00010000:2.0:1788448682.580713:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1788448678 00002000:00010000:2.0:1788448682.580716:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1788448681 -> 1788448680 00002000:00010000:2.0:1788448682.580748:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1788448682.580856:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+8:2353:x1875323902885120:12345-192.168.204.37@tcp:2:lhsmtool_posix.0 Request processed in 458us (1926us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788448682.580865:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:3.0:1788448682.588787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.590448:0:15539:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885248 00000100:00100000:0.0:1788448682.590468:0:15539:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885248 00000100:00100000:2.0:1788448682.590936:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:2.0:1788448682.590954:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+8:2352:x1875323902885248:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1788448682.591483:0:15107:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.591515:0:15107:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 8 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.591536:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448682.591543:0:15107:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788448682.591549:0:15107:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.591619:0:15107:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 8 pid: 15108 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.591639:0:15107:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 8 pid: 15108 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448682.591659:0:15107:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15107:1875323926982784:192.168.204.37@tcp:104: 00000100:00100000:2.0:1788448682.591798:0:15107:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a809ed4600 going to sleep for 11 seconds 00000100:00100000:3.0:1788448682.596424:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926983040:0@lo:400:kworker.0 00000100:00100000:3.0:1788448682.596527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788448682.596830:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.596864:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885376 00000100:00100000:1.0:1788448682.596889:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885376 00010000:00010000:1.0:1788448682.596942:0:14408:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.598480:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788448682.598548:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926983168:0@lo:400:kworker.0 00000100:00100000:3.0:1788448682.598646:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448682.599327:0:15107:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:15107:1875323926982784:192.168.204.37@tcp:104: 00010000:00010000:2.0:1788448682.599364:0:15107:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.599604:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1788448682.599634:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a047eef-0fdc-4732-b562-29a19de3e157+9:2352:x1875323902885376:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788448682.599656:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788448682.599692:0:14408:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.599707:0:14408:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.599736:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c8924e/0xd0e9b344b90ac55c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f4b expref: 9 pid: 15108 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.599780:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448682.599786:0:14408:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788448682.599794:0:14408:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.599807:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.599850:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788448682.599941:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:6a047eef-0fdc-4732-b562-29a19de3e157+8:2352:x1875323902885376:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 319us (3113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.601404:0:16303:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983168 00000100:00100000:3.0:1788448682.601423:0:16303:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983168 00000100:00100000:3.0:1788448682.601503:0:16303:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448682.601516:0:16303:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926983168:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1788448682.601767:0:15107:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601782:0:15107:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601824:0:15107:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601833:0:15107:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601843:0:15107:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601851:0:15107:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031000 already unused, calling callback (ffffffffc162d230) 00010000:00010000:2.0:1788448682.601856:0:15107:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601865:0:15107:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601930:0:15107:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.601938:0:15107:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a246d86/0xd0e9b344b90ac563 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15107 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448682.602240:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a7056c4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6a047eef-0fdc-4732-b562-29a19de3e157+8:2352:x1875323902885248:12345-192.168.204.37@tcp:1:lhsmtool_posix.0 Request processed in 11235us (13416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.602253:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:2.0:1788448682.602285:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983040 00000100:00100000:2.0:1788448682.602291:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983040 00000100:00100000:2.0:1788448682.602341:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788448682.602350:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926983040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.602436:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926983040:12345-0@lo:400:kworker.0 Request processed in 88us (5910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.602442:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788448682.602740:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:1.0:1788448682.604510:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926983296:0@lo:400:kworker.0 00000100:00100000:3.0:1788448682.608309:0:16303:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1875323926983168:12345-0@lo:400:kworker.0 Request processed in 6780us (9647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.608328:0:16303:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788448682.608396:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788448682.608458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788448682.608525:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807975f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3311:1875323926983168:0@lo:400:kworker.0 00000100:00100000:3.0:1788448682.608549:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807977b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926983040:0@lo:400:kworker.0 00000100:00080000:3.0:1788448682.608602:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788448682.608620:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983552 00000100:00100000:3.0:1788448682.608628:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983552 00000100:00100000:3.0:1788448682.608687:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448682.608696:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926983552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788448682.608756:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1788448682.608806:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807974000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926983552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.608812:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788448682.608846:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926983552:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788448682.612440:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a7056c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926982912:0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.612687:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448682.612906:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926982912 00000100:00100000:0.0:1788448682.612917:0:14415:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926982912 00000100:00100000:2.0:1788448682.613590:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a807974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926983424:0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.613646:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448682.613954:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788448682.613971:0:14415:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:3310:x1875323926982912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788448682.614075:0:14415:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e728050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5961e328-478c-41d0-979d-0dab1f06ac13+19:3310:x1875323926982912:12345-0@lo:400:kworker.0 Request processed in 108us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.614084:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1788448682.614118:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a7056c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5961e328-478c-41d0-979d-0dab1f06ac13:3310:1875323926982912:0@lo:400:kworker.0 00000100:00100000:1.0:1788448682.614313:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448682.614400:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983424 00000100:00100000:2.0:1788448682.614407:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983424 00000100:00100000:2.0:1788448682.614468:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983296 00000100:00100000:2.0:1788448682.614480:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983296 00000100:00100000:2.0:1788448682.614511:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448682.614519:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926983424:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.614567:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1875323926983424:12345-0@lo:400:kworker.0 Request processed in 48us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.614573:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788448682.614600:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448682.614606:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a704686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926983296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.614640:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a704686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1875323926983296:12345-0@lo:400:kworker.0 Request processed in 34us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.614646:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788448682.614684:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807974a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3310:1875323926983424:0@lo:400:kworker.0 00000100:00100000:2.0:1788448682.614709:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a807977100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3309:1875323926983296:0@lo:400:kworker.0 00000100:00080000:1.0:1788448682.614764:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788448682.617125:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.617281:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885632 00000100:00100000:1.0:1788448682.617300:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885632 00000100:00100000:1.0:1788448682.617387:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 60 00000100:00100000:1.0:1788448682.617400:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+13:14547:x1875323902885632:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788448682.617523:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.617561:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.617651:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.618517:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.618660:0:14420:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 14 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.618670:0:14420:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.618723:0:14420:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 14 pid: 16303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.618807:0:14420:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 14 pid: 16303 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.618829:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875323926983680:192.168.204.37@tcp:104: 00000100:00100000:1.0:1788448682.618975:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448682.626621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.626861:0:16541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885760 00000100:00100000:0.0:1788448682.626887:0:16541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885760 00010000:00010000:0.0:1788448682.626946:0:16541:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 15 pid: 16303 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448682.627017:0:16541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 16 00000100:00100000:0.0:1788448682.627031:0:16541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a047eef-0fdc-4732-b562-29a19de3e157+15:2352:x1875323902885760:12345-192.168.204.37@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788448682.627053:0:16541:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788448682.627062:0:16541:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 15 pid: 16303 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.627079:0:16541:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 15 pid: 16303 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.627111:0:16541:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:0.0:1788448682.627117:0:16541:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.627130:0:16541:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.627138:0:16541:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.627164:0:16541:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788448682.627277:0:16541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:6a047eef-0fdc-4732-b562-29a19de3e157+15:2352:x1875323902885760:12345-192.168.204.37@tcp:103:ldlm_bl.0 Request processed in 247us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.627287:0:16541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 16 00010000:00010000:1.0:1788448682.628861:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758000/0xd0e9b344b90ac539 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f36 expref: 14 pid: 16303 timeout: 643 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788448682.628907:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a704684000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875323926983680:192.168.204.37@tcp:104: 00010000:00010000:1.0:1788448682.628928:0:14420:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.628940:0:14420:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788448682.628946:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788448682.629495:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:1.0:1788448682.629926:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:1.0:1788448682.629992:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:1.0:1788448682.630181:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14420:1875323926983808:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788448682.637581:0:14420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448682.637817:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983808 00000100:00100000:0.0:1788448682.637834:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983808 00000100:00100000:0.0:1788448682.637930:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788448682.637945:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1875323926983808:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788448682.638017:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808a5be40 going to sleep for 11 seconds 00000100:00100000:0.0:1788448682.644240:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1875323926983808:12345-0@lo:1000:mdt00_000.0 Request processed in 6279us (6648us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448682.644268:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788448682.644270:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835639c00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14420:1875323926983808:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788448682.645448:0:14420:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934627 00000100:00100000:2.0:1788448682.645575:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14420:1875323926983936:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788448682.645683:0:14420:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788448682.645732:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808acc540 going to sleep for 11 seconds 00000100:00100000:0.0:1788448682.646744:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926983936 00000100:00100000:0.0:1788448682.646761:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926983936 00000100:00100000:0.0:1788448682.646829:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788448682.646841:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14420:x1875323926983936:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788448682.650240:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14420:1875323926983936:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788448682.650314:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650327:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650346:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650373:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092eda00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448682.650379:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650387:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650408:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:2.0:1788448682.650411:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448682.650417:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650423:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092eda00/0xd0e9b344b90ac571 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650466:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650473:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650481:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650486:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a800031a00 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:2.0:1788448682.650489:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650495:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650518:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:2.0:1788448682.650520:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788448682.650529:0:14420:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650542:0:14420:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650553:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.650628:0:14420:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ed800/0xd0e9b344b90ac4d0 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f1a expref: 17 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788448682.650645:0:14420:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875323926984064:192.168.204.37@tcp:105: 00000100:00100000:0.0:1788448682.650965:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a70776a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14420:x1875323926983936:12345-0@lo:1000:mdt00_000.0 Request processed in 3135us (4291us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788448682.650978:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788448682.652046:0:14420:0:(client.c:2715:ptlrpc_set_wait()) set ffff99a808accf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788448682.671730:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:0.0:1788448682.671905:0:14420:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a70776a300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14420:1875323926984064:192.168.204.37@tcp:105: 00010000:00010000:0.0:1788448682.671953:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.671966:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031a00/0xd0e9b344b90ac4c9 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000020 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672028:0:14420:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672046:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672081:0:14420:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672094:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672101:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672108:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672113:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a810758200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448682.672117:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672124:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672138:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:0.0:1788448682.672141:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788448682.672145:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672151:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a810758200/0xd0e9b344b90ac578 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672166:0:14420:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672171:0:14420:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672383:0:14420:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672392:0:14420:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a8092ec600 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:0.0:1788448682.672396:0:14420:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672403:0:14420:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672412:0:14420:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:0.0:1788448682.672415:0:14420:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788448682.672418:0:14420:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.672425:0:14420:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a8092ec600/0xd0e9b344b90ac56a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14420 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788448682.672759:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807977b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6a047eef-0fdc-4732-b562-29a19de3e157+17:14547:x1875323902885632:12345-192.168.204.37@tcp:57:lhsmtool_posix.0 Request processed in 55359us (55647us total) trans 8589934628 rc 0/0 00000100:00100000:0.0:1788448682.672772:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 60 00000020:00080000:0.0:1788448682.672780:0:14420:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788448682.673142:0:14452:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788448682.673148:0:14452:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788448682.673180:0:14452:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788448682.673219:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788448682.676914:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902885888 00000100:00100000:3.0:1788448682.676959:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902885888 00000100:00100000:0.0:1788448682.677640:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.677714:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902886144 00000100:00100000:3.0:1788448682.677721:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902886144 00000100:00100000:3.0:1788448682.677790:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 12 00000100:00100000:3.0:1788448682.677803:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+18:14547:x1875323902886144:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788448682.679963:0:14424:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788448682.680112:0:14424:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934629 00010000:00010000:3.0:1788448682.680550:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680573:0:14424:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680587:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680598:0:14424:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680605:0:14424:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680611:0:14424:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.680683:0:14424:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788448682.680851:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835421180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+20:14547:x1875323902886144:12345-192.168.204.37@tcp:35:lhsmtool_posix.0 Request processed in 3045us (3213us total) trans 8589934630 rc 0/0 00000100:00100000:3.0:1788448682.680864:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 12 00000020:00080000:3.0:1788448682.680885:0:14424:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788448682.681064:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 13 00000100:00100000:2.0:1788448682.681078:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a707769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14546:x1875323902885888:12345-192.168.204.37@tcp:49:bash.0 00000100:00100000:2.0:1788448682.681211:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a707769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14546:x1875323902885888:12345-192.168.204.37@tcp:49:bash.0 Request processed in 135us (9501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.681218:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 13 00010000:00010000:0.0:1788448682.685019:0:16125:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788448682.685041:0:16125:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.685055:0:16125:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b400 already unused, calling callback (ffffffffc162d230) 00010000:00010000:0.0:1788448682.685060:0:16125:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.685103:0:16125:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.685128:0:16125:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff99a820d0fd00) 00010000:00010000:0.0:1788448682.685132:0:16125:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788448682.685138:0:16125:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.685144:0:16125:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b400/0xd0e9b344b90ac57f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14424 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788448682.685169:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448682.685171:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448682.685173:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448682.687657:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:2.0:1788448682.687849:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902886272 00000100:00100000:2.0:1788448682.687864:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902886272 00000100:00100000:2.0:1788448682.688010:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:2.0:1788448682.688023:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+7:14546:x1875323902886272:12345-192.168.204.37@tcp:101:bash.0 00010000:00010000:2.0:1788448682.688049:0:15106:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448682.688077:0:15106:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004652a30b/0xd0e9b344b90ac586 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f52 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788448682.688114:0:15106:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a998fa8, atime: 0x6a998fa6, ctime: 0x6a998fa8, blocks: 0x1 00010000:00010000:2.0:1788448682.688143:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=543s v=(0 0) 00010000:00010000:2.0:1788448682.688148:0:15106:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788448682.688161:0:15106:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004652a30b/0xd0e9b344b90ac586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f52 expref: 8 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.688180:0:15106:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004652a30b/0xd0e9b344b90ac586 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f52 expref: 8 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.688224:0:15106:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800030e00, rc 0) 00000100:00100000:2.0:1788448682.688308:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+8:14546:x1875323902886272:12345-192.168.204.37@tcp:101:bash.0 Request processed in 287us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788448682.688316:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448682.692789:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.693245:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902886528 00000100:00100000:3.0:1788448682.693280:0:14423:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902886528 00000100:00100000:3.0:1788448682.693366:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 14 00000100:00100000:3.0:1788448682.693380:0:14423:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+19:14546:x1875323902886528:12345-192.168.204.37@tcp:35:bash.0 00000001:00080000:3.0:1788448682.694134:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934631 00000001:00080000:3.0:1788448682.694314:0:14423:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934632 00000100:00100000:3.0:1788448682.697527:0:14423:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:6a047eef-0fdc-4732-b562-29a19de3e157+22:14546:x1875323902886528:12345-192.168.204.37@tcp:35:bash.0 Request processed in 4131us (4733us total) trans 8589934633 rc 0/0 00000100:00100000:3.0:1788448682.697545:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 14 00000020:00080000:3.0:1788448682.697554:0:14423:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788448682.801906:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448682.803218:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902886784 00000100:00100000:1.0:1788448682.803240:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902886784 00000100:00100000:2.0:1788448682.803754:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:2.0:1788448682.803769:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+22:14557:x1875323902886784:12345-192.168.204.37@tcp:101:lfs.0 00010000:00010000:2.0:1788448682.803810:0:14421:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788448682.803845:0:14421:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac58d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe09f3eeba0510f59 expref: -99 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788448682.804046:0:14421:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1788448682.804249:0:14421:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac58d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f59 expref: 24 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.804268:0:14421:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff99a808bbf200) 00010000:00010000:2.0:1788448682.804272:0:14421:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788448682.804277:0:14421:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a800031e00/0xd0e9b344b90ac58d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.37@tcp remote: 0xe09f3eeba0510f59 expref: 24 pid: 14421 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788448682.804295:0:14421:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff99a800031e00, rc 0) 00000100:00100000:2.0:1788448682.804917:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a807975f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+23:14557:x1875323902886784:12345-192.168.204.37@tcp:101:lfs.0 Request processed in 1136us (3014us total) trans 8589934634 rc 301/301 00000100:00100000:2.0:1788448682.804928:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 61 00000100:00100000:1.0:1788448682.809534:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.809719:0:14422:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902886912 00000100:00100000:3.0:1788448682.809733:0:14422:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902886912 00000100:00100000:3.0:1788448682.809897:0:14422:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:3.0:1788448682.809911:0:14422:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+23:14557:x1875323902886912:12345-192.168.204.37@tcp:34:lfs.0 00010000:00010000:3.0:1788448682.810310:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/1,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.810861:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.810895:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.810919:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.810927:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.810933:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812095:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812114:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812125:0:14422:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788448682.812230:0:14422:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812246:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/1,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812253:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812261:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812267:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b800 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448682.812273:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812281:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812297:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff99a820d0f100) 00010000:00010000:3.0:1788448682.812301:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448682.812306:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812325:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b800/0xd0e9b344b90ac59b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812803:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812815:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812822:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812828:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6a000 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448682.812831:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812838:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812848:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff99a820d0f900) 00010000:00010000:3.0:1788448682.812852:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448682.812855:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812861:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6a000/0xd0e9b344b90ac5a2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812896:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812902:0:14422:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812920:0:14422:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812925:0:14422:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff99a706b6b200 already unused, calling callback (ffffffffc206d4f0) 00010000:00010000:3.0:1788448682.812929:0:14422:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812935:0:14422:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812944:0:14422:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff99a804d04300) 00010000:00010000:3.0:1788448682.812947:0:14422:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788448682.812950:0:14422:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788448682.812956:0:14422:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff99a706b6b200/0xd0e9b344b90ac5a9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14422 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788448682.813232:0:14422:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a834d38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6a047eef-0fdc-4732-b562-29a19de3e157+23:14557:x1875323902886912:12345-192.168.204.37@tcp:34:lfs.0 Request processed in 3271us (3660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788448682.813246:0:14422:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 62 00000100:00100000:1.0:1788448682.816883:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:3.0:1788448682.817480:0:14424:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887168 00000100:00100000:3.0:1788448682.817495:0:14424:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887168 00000100:00100000:3.0:1788448682.817578:0:14424:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 15 00000100:00100000:3.0:1788448682.817690:0:14424:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+23:14557:x1875323902887168:12345-192.168.204.37@tcp:35:lfs.0 00000100:00100000:3.0:1788448682.819970:0:14424:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a835639c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:14557:x1875323902887168:12345-192.168.204.37@tcp:35:lfs.0 Request processed in 2362us (3097us total) trans 8589934635 rc 0/0 00000100:00100000:3.0:1788448682.820003:0:14424:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 15 00010000:00010000:0.0:1788448682.914299:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788448683.217272:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00000001:00080000:1.0:1788448683.220769:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934596 is committed 00010000:00010000:3.0:1788448683.941957:0:14410:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448683.966568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966625:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966684:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966705:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966730:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448683.966787:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887808 00000100:00100000:1.0:1788448683.966799:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887808 00000100:00100000:1.0:1788448683.966883:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887424 00000100:00100000:1.0:1788448683.966887:0:14421:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887424 00000100:00100000:1.0:1788448683.966913:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:1.0:1788448683.966925:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2355:x1875323902887808:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967062:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49a983be-943b-4a5c-88b2-af962c3d45bc+6:2355:x1875323902887808:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 138us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967071:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 31 00000100:00100000:1.0:1788448683.967090:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:1.0:1788448683.967096:0:14421:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:2355:x1875323902887424:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967121:0:14421:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6a047eef-0fdc-4732-b562-29a19de3e157+24:2355:x1875323902887424:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 26us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967128:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 32 00000100:00100000:1.0:1788448683.967144:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887552 00000100:00100000:1.0:1788448683.967147:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887552 00000100:00100000:1.0:1788448683.967164:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902888064 00000100:00100000:1.0:1788448683.967166:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902888064 00000100:00100000:1.0:1788448683.967176:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887680 00000100:00100000:1.0:1788448683.967178:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887680 00000100:00100000:1.0:1788448683.967219:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887936 00000100:00100000:1.0:1788448683.967222:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887936 00000100:00100000:1.0:1788448683.967237:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:1.0:1788448683.967242:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902887552:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967266:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902887552:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 24us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967273:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 17 00000100:00100000:1.0:1788448683.967283:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:1.0:1788448683.967288:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902888064:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967307:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902888064:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 19us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967324:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 18 00000100:00100000:1.0:1788448683.967337:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1788448683.967343:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902887680:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967364:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+5:2355:x1875323902887680:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 22us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967370:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 19 00000100:00100000:1.0:1788448683.967378:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00100000:1.0:1788448683.967383:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902887936:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:1.0:1788448683.967399:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49a983be-943b-4a5c-88b2-af962c3d45bc+5:2355:x1875323902887936:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 16us (645us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448683.967405:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 20 00000100:00080000:1.0:1788448683.967420:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788448683.967424:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788448683.967426:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788448683.967645:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902887296 00000100:00100000:0.0:1788448683.967650:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902887296 00000100:00100000:0.0:1788448683.967693:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 124 00000100:00100000:0.0:1788448683.967701:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2355:x1875323902887296:12345-192.168.204.37@tcp:400:kworker.0 00000100:00100000:0.0:1788448683.967739:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83e729050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:2b87d97b-2a51-4dd7-b64d-d66fcebdef11+13:2355:x1875323902887296:12345-192.168.204.37@tcp:400:kworker.0 Request processed in 40us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448683.967746:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 124 00000001:02000400:2.0:1788448684.648059:0:16694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: /mnt/lustre/d1c.sanity-pcc/f1c.sanity-pcc expected pcc state: readwrite, but got: none 00010000:00010000:0.0:1788448684.960285:0:16125:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788448685.986495:0:14409:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788448686.016117:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448686.016241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.37@tcp (source: 12345-192.168.204.37@tcp) 00000100:00100000:1.0:1788448686.016278:0:15106:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902888320 00000100:00100000:1.0:1788448686.016291:0:15106:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902888320 00000100:00100000:1.0:1788448686.016381:0:15106:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00100000:1.0:1788448686.016394:0:15106:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902888320:12345-192.168.204.37@tcp:16:kworker.0 00000100:00100000:1.0:1788448686.017387:0:15106:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2355:x1875323902888320:12345-192.168.204.37@tcp:16:kworker.0 Request processed in 990us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1788448686.017399:0:15106:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 21 00000100:00080000:1.0:1788448686.017438:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788448686.017814:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323902888192 00000100:00100000:2.0:1788448686.017824:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323902888192 00002000:00100000:2.0:1788448686.017871:0:15111:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff99a83d1a6d80 x1875323902888192/t0(0) o4->6a047eef-0fdc-4732-b562-29a19de3e157@192.168.204.37@tcp:167/0 lens 504/0 e 0 to 0 dl 1788448697 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788448686.017882:0:15111:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1a6d80 with x1875323902888192 ext(0->8) 00002000:00010000:2.0:1788448686.017889:0:15111:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1a6d80 00000100:00100000:2.0:1788448686.017927:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.37@tcp, seq: 0 00000100:00100000:2.0:1788448686.017936:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a047eef-0fdc-4732-b562-29a19de3e157+6:2354:x1875323902888192:12345-192.168.204.37@tcp:4:bash.0 00000100:00100000:2.0:1788448686.019369:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:6a047eef-0fdc-4732-b562-29a19de3e157+8:2354:x1875323902888192:12345-192.168.204.37@tcp:4:bash.0 Request processed in 1422us (3255us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1788448686.019394:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.37@tcp, seq: 0 00002000:00100000:2.0:1788448686.019408:0:15111:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x22:0x0] (0->8) req@ffff99a83d1a6d80 x1875323902888192/t8589934598(0) o4->6a047eef-0fdc-4732-b562-29a19de3e157@192.168.204.37@tcp:167/0 lens 504/448 e 0 to 0 dl 1788448697 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:100 00002000:00100000:2.0:1788448686.019418:0:15111:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff99a83d1a6d80 with x1875323902888192 ext(0->8) 00002000:00010000:2.0:1788448686.019424:0:15111:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff99a83d1a6d80 00000100:00100000:1.0:1788448686.176523:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788448686.176559:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff99a835420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926984192:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788448686.176688:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788448686.176852:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875323926984192 00000100:00100000:0.0:1788448686.176864:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875323926984192 00000100:00100000:0.0:1788448686.176945:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788448686.176958:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff99a83d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926984192:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788448686.177021:0:15110:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1788448686.177087:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff99a83d1a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1875323926984192:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788448686.177096:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1788448686.177178:0:14416:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788448686.177242:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1788448686.177250:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff99a834f1ed80, transno 8589934595 00000004:00080000:3.0:1788448686.177269:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1788448686.177306:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff99a835420a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3311:1875323926984192:0@lo:13:osp-pre-0-0.0 Debug log: 30013 lines, 30013 kept, 0 dropped, 0 bad.